[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:57:48 dist-test-slave-gw5c krb5kdc[24873](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:57:48 dist-test-slave-gw5c krb5kdc[24873](info): set up 2 sockets
Aug 08 09:57:48 dist-test-slave-gw5c krb5kdc[24873](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 09:57:49.559106 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:57:49 dist-test-slave-gw5c krb5kdc[24873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:57:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:57:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:57:49.690256 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:39419
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:39419
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:49.777190 24890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:49.777470 24890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:49.777515 24890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:49.778748 24890 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:57:49.778829 24890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:49.778860 24890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:49.778895 24890 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:57:49.778926 24890 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:57:49.780670 24890 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:39419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:39419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:49.780982 24890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:49.781301 24890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:49.787209 24900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:49.787246 24901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:49.787911 24890 server_base.cc:1034] running on GCE node
W20260808 09:57:49.788087 24903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:49.788457 24890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:49.788753 24890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:49.790014 24890 hybrid_clock.cc:648] HybridClock initialized: now 1786183069790005 us; error 79 us; skew 500 ppm
Aug 08 09:57:49 dist-test-slave-gw5c krb5kdc[24873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183069, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:49.792851 24890 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:57:49.793344 24890 webserver.cc:460] Webserver started at http://127.24.71.254:41043/ using document root <none> and password file <none>
I20260808 09:57:49.793602 24890 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:49.793650 24890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:49.793814 24890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:49.795215 24890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "b96c3ac02b8b4708ac0f9297458088c2"
format_stamp: "Formatted at 2026-08-08 09:57:49 on dist-test-slave-gw5c"
server_key: "c8044a31a5bad6d50b52746c4e3339ca"
server_key_iv: "2ea482d7a303f152c09ab4f7436bd3f7"
server_key_version: "encryptionkey@0"
I20260808 09:57:49.795954 24890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "b96c3ac02b8b4708ac0f9297458088c2"
format_stamp: "Formatted at 2026-08-08 09:57:49 on dist-test-slave-gw5c"
server_key: "c8044a31a5bad6d50b52746c4e3339ca"
server_key_iv: "2ea482d7a303f152c09ab4f7436bd3f7"
server_key_version: "encryptionkey@0"
I20260808 09:57:49.797490 24890 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:57:49.798349 24917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:49.798592 24890 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:57:49.798681 24890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "b96c3ac02b8b4708ac0f9297458088c2"
format_stamp: "Formatted at 2026-08-08 09:57:49 on dist-test-slave-gw5c"
server_key: "c8044a31a5bad6d50b52746c4e3339ca"
server_key_iv: "2ea482d7a303f152c09ab4f7436bd3f7"
server_key_version: "encryptionkey@0"
I20260808 09:57:49.798795 24890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:49.816031 24890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:49.818022 24890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:49.818161 24890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:49.824687 24890 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:39419
I20260808 09:57:49.824743 24986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:39419 every 8 connection(s)
I20260808 09:57:49.825352 24890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:57:49.826112 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 24890
I20260808 09:57:49.826228 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:57:49.826215 24987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:49.826884 24863 external_mini_cluster.cc:1428] Setting key e22e601b8f90fcff21785e46641913e0
I20260808 09:57:49.829344 24987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2: Bootstrap starting.
I20260808 09:57:49.829964 24987 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:49.830261 24987 log.cc:824] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2: Log is configured to *not* fsync() on all Append() calls
I20260808 09:57:49.831017 24987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2: No bootstrap required, opened a new log
I20260808 09:57:49.833218 24987 raft_consensus.cc:348] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96c3ac02b8b4708ac0f9297458088c2" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 39419 } }
I20260808 09:57:49.833431 24987 raft_consensus.cc:374] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:49.833518 24987 raft_consensus.cc:729] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b96c3ac02b8b4708ac0f9297458088c2, State: Initialized, Role: FOLLOWER
I20260808 09:57:49.833694 24987 consensus_queue.cc:260] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96c3ac02b8b4708ac0f9297458088c2" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 39419 } }
I20260808 09:57:49.833796 24987 raft_consensus.cc:388] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:57:49.833844 24987 raft_consensus.cc:482] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:57:49.833894 24987 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:49.834444 24987 raft_consensus.cc:504] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96c3ac02b8b4708ac0f9297458088c2" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 39419 } }
I20260808 09:57:49.834543 24987 leader_election.cc:302] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b96c3ac02b8b4708ac0f9297458088c2; no voters:
I20260808 09:57:49.834733 24987 leader_election.cc:288] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:57:49.834758 24997 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:57:49.834887 24997 raft_consensus.cc:686] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [term 1 LEADER]: Becoming Leader. State: Replica: b96c3ac02b8b4708ac0f9297458088c2, State: Running, Role: LEADER
I20260808 09:57:49.835013 24987 sys_catalog.cc:564] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:57:49.835037 24997 consensus_queue.cc:237] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96c3ac02b8b4708ac0f9297458088c2" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 39419 } }
I20260808 09:57:49.835507 24998 sys_catalog.cc:455] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b96c3ac02b8b4708ac0f9297458088c2. Latest consensus state: current_term: 1 leader_uuid: "b96c3ac02b8b4708ac0f9297458088c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96c3ac02b8b4708ac0f9297458088c2" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 39419 } } }
I20260808 09:57:49.835520 24999 sys_catalog.cc:455] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b96c3ac02b8b4708ac0f9297458088c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96c3ac02b8b4708ac0f9297458088c2" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 39419 } } }
I20260808 09:57:49.835649 24998 sys_catalog.cc:458] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [sys.catalog]: This master's current role is: LEADER
I20260808 09:57:49.835692 24999 sys_catalog.cc:458] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2 [sys.catalog]: This master's current role is: LEADER
I20260808 09:57:49.836694 25008 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:57:49.837337 25008 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:57:49.839589 25008 catalog_manager.cc:1347] Generated new cluster ID: bcbf1ebfd9e343f4bdf8625507004619
Aug 08 09:57:49 dist-test-slave-gw5c krb5kdc[24873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:49.839648 25008 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:57:49.844054 24989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:49.827974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38870 (local address 127.24.71.254:39419)
0808 09:57:49.828208 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:49.828218 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:49.828489 (+ 271us) server_negotiation.cc:407] Connection header received
0808 09:57:49.830725 (+ 2236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:49.830731 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:49.830786 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:49.830938 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:49.832584 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:49.833715 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:49.835027 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:49.835636 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:49.835726 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:49.840307 (+ 4581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:49.840311 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:49.840313 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:49.840330 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:49.842085 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:49.842581 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:49.842584 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:49.842585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:49.842678 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:49.842960 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:49.842961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:49.842961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:49.843199 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:49.843372 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:49.843690 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 09:57:49.843826 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":87,"threads_started":1}
I20260808 09:57:49.857551 25008 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:57:49.858116 25008 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:57:49.860148 25008 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b96c3ac02b8b4708ac0f9297458088c2: Generated new TSK 0
I20260808 09:57:49.860337 25008 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 09:57:49.896095 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:39419
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:50.012568 25025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:50.012864 25025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:50.012907 25025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:50.014530 25025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:50.014585 25025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:50.014616 25025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:57:50.016268 25025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:39419
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:50.016549 25025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:50.016808 25025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:50.022022 25030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:50.022169 25031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:50.022044 25033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:50.022207 25025 server_base.cc:1034] running on GCE node
I20260808 09:57:50.022542 25025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:50.022816 25025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:50.024001 25025 hybrid_clock.cc:648] HybridClock initialized: now 1786183070023978 us; error 36 us; skew 500 ppm
Aug 08 09:57:50 dist-test-slave-gw5c krb5kdc[24873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183070, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:50.026669 25025 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 09:57:50.027133 25025 webserver.cc:460] Webserver started at http://127.24.71.193:33217/ using document root <none> and password file <none>
I20260808 09:57:50.027478 25025 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:50.027554 25025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:50.027709 25025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:50.028779 25025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "c227e64ddbc4459fbcd3d54cba955f27"
format_stamp: "Formatted at 2026-08-08 09:57:50 on dist-test-slave-gw5c"
server_key: "d3368dd3472cbafe93ce512125f12b11"
server_key_iv: "720fc32afbd17f559167a510b6cc17dd"
server_key_version: "encryptionkey@0"
I20260808 09:57:50.029165 25025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "c227e64ddbc4459fbcd3d54cba955f27"
format_stamp: "Formatted at 2026-08-08 09:57:50 on dist-test-slave-gw5c"
server_key: "d3368dd3472cbafe93ce512125f12b11"
server_key_iv: "720fc32afbd17f559167a510b6cc17dd"
server_key_version: "encryptionkey@0"
I20260808 09:57:50.030543 25025 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 09:57:50.031369 25047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:50.031816 25025 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:57:50.031924 25025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "c227e64ddbc4459fbcd3d54cba955f27"
format_stamp: "Formatted at 2026-08-08 09:57:50 on dist-test-slave-gw5c"
server_key: "d3368dd3472cbafe93ce512125f12b11"
server_key_iv: "720fc32afbd17f559167a510b6cc17dd"
server_key_version: "encryptionkey@0"
I20260808 09:57:50.032015 25025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:50.063761 25025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:50.065806 25025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:50.065992 25025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:50.066255 25025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:57:50.066606 25025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:57:50.066666 25025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:50.066705 25025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:57:50.066754 25025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:50.073174 25025 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:41633
I20260808 09:57:50.073221 25218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:41633 every 8 connection(s)
I20260808 09:57:50.073565 25025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
Aug 08 09:57:50 dist-test-slave-gw5c krb5kdc[24873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183070, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:50.083446 24989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:50.074277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:57095 (local address 127.24.71.254:39419)
0808 09:57:50.074343 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:50.074346 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:50.074551 (+ 205us) server_negotiation.cc:407] Connection header received
0808 09:57:50.075058 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:50.075058 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:50.075069 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:50.075132 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:50.076190 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.076715 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.077865 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.078078 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.078153 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:50.080668 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:50.080670 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:50.080670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:50.080678 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:50.082024 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:50.082407 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:50.082408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:50.082408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:50.082472 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:50.082705 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:50.082706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:50.082706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:50.082818 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:50.082878 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:50.083159 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 09:57:50.083321 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 09:57:50.083534 25225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:50.074255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:39419 (local address 127.24.71.193:57095)
0808 09:57:50.074424 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:50.074469 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:50.074971 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:50.075211 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:50.075215 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:50.075899 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:50.076100 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:50.076105 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.076824 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.076825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:50.077758 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:50.077761 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.078181 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.078182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:50.078329 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:50.078845 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:50.078854 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:50.080574 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:50.082101 (+ 1527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:50.082108 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:50.082110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:50.082335 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:50.082540 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:50.082540 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:50.082541 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:50.082647 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:50.082877 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:50.082882 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:50.083007 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 09:57:50.083093 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 09:57:50.083215 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":99,"threads_started":1}
I20260808 09:57:50.083537 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 25025
I20260808 09:57:50.083616 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:57:50.083783 24863 external_mini_cluster.cc:1428] Setting key f91ca7f96d0690d4b9e47b0b0fdb013b
I20260808 09:57:50.084102 25222 heartbeater.cc:347] Connected to a master server at 127.24.71.254:39419
I20260808 09:57:50.084209 25222 heartbeater.cc:464] Registering TS with master...
I20260808 09:57:50.084403 25222 heartbeater.cc:511] Master 127.24.71.254:39419 requested a full tablet report, sending...
I20260808 09:57:50.084985 24940 ts_manager.cc:194] Registered new tserver with Master: c227e64ddbc4459fbcd3d54cba955f27 (127.24.71.193:41633)
I20260808 09:57:50.085621 24940 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:57095
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 09:57:50.112803 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:39419
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:50.196913 25229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:50.197105 25229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:50.197129 25229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:50.198261 25229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:50.198304 25229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:50.198330 25229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:57:50.199885 25229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:39419
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:50.200124 25229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:50.200372 25229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:50.205610 25240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:50.205634 25237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:50.205884 25229 server_base.cc:1034] running on GCE node
W20260808 09:57:50.205649 25238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:50.206146 25229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:50.206359 25229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:50.207541 25229 hybrid_clock.cc:648] HybridClock initialized: now 1786183070207534 us; error 41 us; skew 500 ppm
Aug 08 09:57:50 dist-test-slave-gw5c krb5kdc[24873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183070, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:50.210372 25229 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 09:57:50.210862 25229 webserver.cc:460] Webserver started at http://127.24.71.194:37147/ using document root <none> and password file <none>
I20260808 09:57:50.211124 25229 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:50.211201 25229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:50.211457 25229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:50.212637 25229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "4f2553db7e0548e58b46a53e15ffaea0"
format_stamp: "Formatted at 2026-08-08 09:57:50 on dist-test-slave-gw5c"
server_key: "6342de70b3c4be7e28dc8cebecf0c527"
server_key_iv: "767c6096c2e4c7fc8d84ce9337c0a637"
server_key_version: "encryptionkey@0"
I20260808 09:57:50.213037 25229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "4f2553db7e0548e58b46a53e15ffaea0"
format_stamp: "Formatted at 2026-08-08 09:57:50 on dist-test-slave-gw5c"
server_key: "6342de70b3c4be7e28dc8cebecf0c527"
server_key_iv: "767c6096c2e4c7fc8d84ce9337c0a637"
server_key_version: "encryptionkey@0"
I20260808 09:57:50.214519 25229 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 09:57:50.215489 25252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:50.215682 25229 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:57:50.215808 25229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "4f2553db7e0548e58b46a53e15ffaea0"
format_stamp: "Formatted at 2026-08-08 09:57:50 on dist-test-slave-gw5c"
server_key: "6342de70b3c4be7e28dc8cebecf0c527"
server_key_iv: "767c6096c2e4c7fc8d84ce9337c0a637"
server_key_version: "encryptionkey@0"
I20260808 09:57:50.215903 25229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:50.233960 25229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:50.236620 25229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:50.236805 25229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:50.237074 25229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:57:50.237430 25229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:57:50.237495 25229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:50.237545 25229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:57:50.237573 25229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:50.244060 25229 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:45057
I20260808 09:57:50.244112 25420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:45057 every 8 connection(s)
I20260808 09:57:50.244460 25229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:57:50.248517 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 25229
I20260808 09:57:50.248625 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:57:50.248793 24863 external_mini_cluster.cc:1428] Setting key 4968f45a99ee945402f6a6c1c6daef0d
Aug 08 09:57:50 dist-test-slave-gw5c krb5kdc[24873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183070, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:50.255183 25424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:50.245193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:39419 (local address 127.24.71.194:53701)
0808 09:57:50.245356 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:50.245402 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:50.245908 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:50.246130 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:50.246133 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:50.246744 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:50.246950 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:50.246954 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.247689 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.247690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:50.248588 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:50.248590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.249206 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.249206 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:50.249363 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:50.249965 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:50.249974 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:50.251775 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:50.253737 (+ 1962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:50.253743 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:50.253745 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:50.253986 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:50.254216 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:50.254217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:50.254217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:50.254319 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:50.254657 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:50.254662 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:50.254786 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 09:57:50.254873 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 09:57:50.255014 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
I20260808 09:57:50.255175 24989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:50.245215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:53701 (local address 127.24.71.254:39419)
0808 09:57:50.245302 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:50.245304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:50.245499 (+ 195us) server_negotiation.cc:407] Connection header received
0808 09:57:50.245997 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:50.245998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:50.246007 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:50.246063 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:50.247028 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.247605 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.248738 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.249061 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.249111 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:50.251875 (+ 2764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:50.251877 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:50.251877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:50.251896 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:50.253649 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:50.254070 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:50.254072 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:50.254072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:50.254144 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:50.254415 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:50.254416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:50.254416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:50.254585 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:50.254665 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:50.254925 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 09:57:50.255027 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 09:57:50.255704 25422 heartbeater.cc:347] Connected to a master server at 127.24.71.254:39419
I20260808 09:57:50.255820 25422 heartbeater.cc:464] Registering TS with master...
I20260808 09:57:50.256021 25422 heartbeater.cc:511] Master 127.24.71.254:39419 requested a full tablet report, sending...
I20260808 09:57:50.256480 24940 ts_manager.cc:194] Registered new tserver with Master: 4f2553db7e0548e58b46a53e15ffaea0 (127.24.71.194:45057)
I20260808 09:57:50.256865 24940 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:53701
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 09:57:50.278504 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:39419
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:50.361964 25427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:50.362159 25427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:50.362181 25427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:50.363325 25427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:50.363372 25427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:50.363473 25427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:57:50.364940 25427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:39419
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:50.365178 25427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:50.365406 25427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:50.370337 25436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:50.370472 25427 server_base.cc:1034] running on GCE node
W20260808 09:57:50.370385 25439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:50.370369 25434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:50.370812 25427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:50.371085 25427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:50.372251 25427 hybrid_clock.cc:648] HybridClock initialized: now 1786183070372235 us; error 30 us; skew 500 ppm
Aug 08 09:57:50 dist-test-slave-gw5c krb5kdc[24873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183070, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:50.374837 25427 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 09:57:50.375309 25427 webserver.cc:460] Webserver started at http://127.24.71.195:45339/ using document root <none> and password file <none>
I20260808 09:57:50.375573 25427 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:50.375620 25427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:50.375793 25427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:50.376848 25427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "dec3f5575de64b059816db4ae66786e1"
format_stamp: "Formatted at 2026-08-08 09:57:50 on dist-test-slave-gw5c"
server_key: "cf2503a3b81c24f99ced9182ab0cf76f"
server_key_iv: "6c4147ba575c70ec79470c80ac0d64db"
server_key_version: "encryptionkey@0"
I20260808 09:57:50.377207 25427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "dec3f5575de64b059816db4ae66786e1"
format_stamp: "Formatted at 2026-08-08 09:57:50 on dist-test-slave-gw5c"
server_key: "cf2503a3b81c24f99ced9182ab0cf76f"
server_key_iv: "6c4147ba575c70ec79470c80ac0d64db"
server_key_version: "encryptionkey@0"
I20260808 09:57:50.378538 25427 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:57:50.379284 25449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:50.379503 25427 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:57:50.379599 25427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "dec3f5575de64b059816db4ae66786e1"
format_stamp: "Formatted at 2026-08-08 09:57:50 on dist-test-slave-gw5c"
server_key: "cf2503a3b81c24f99ced9182ab0cf76f"
server_key_iv: "6c4147ba575c70ec79470c80ac0d64db"
server_key_version: "encryptionkey@0"
I20260808 09:57:50.379664 25427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:50.394238 25427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:50.396150 25427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:50.396314 25427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:50.396543 25427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:57:50.396862 25427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:57:50.396915 25427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:50.396951 25427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:57:50.396978 25427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:50.403507 25427 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:41601
I20260808 09:57:50.403597 25619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:41601 every 8 connection(s)
I20260808 09:57:50.403905 25427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
Aug 08 09:57:50 dist-test-slave-gw5c krb5kdc[24873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183070, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:50.413173 24989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:50.404739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:46299 (local address 127.24.71.254:39419)
0808 09:57:50.404788 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:50.404790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:50.405012 (+ 222us) server_negotiation.cc:407] Connection header received
0808 09:57:50.405515 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:50.405516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:50.405527 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:50.405583 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:50.406522 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.407027 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.408044 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.408234 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.408290 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:50.410408 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:50.410410 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:50.410410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:50.410417 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:50.411868 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:50.412286 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:50.412287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:50.412287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:50.412340 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:50.412568 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:50.412568 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:50.412568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:50.412671 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:50.412724 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:50.413043 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 09:57:50.413105 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 09:57:50.413516 25624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:50.404709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:39419 (local address 127.24.71.195:46299)
0808 09:57:50.404875 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:50.404913 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:50.405413 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:50.405637 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:50.405640 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:50.406227 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:50.406430 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:50.406435 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.407112 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.407112 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:50.407965 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:50.407967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.408314 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.408315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:50.408416 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:50.408881 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:50.408890 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:50.410310 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:50.411943 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:50.411951 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:50.411953 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:50.412203 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:50.412400 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:50.412401 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:50.412401 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:50.412510 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:50.412772 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:50.412780 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:50.412913 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 09:57:50.413022 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 09:57:50.413174 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":99,"threads_started":1}
I20260808 09:57:50.413872 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 25427
I20260808 09:57:50.413983 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:57:50.414162 24863 external_mini_cluster.cc:1428] Setting key e50f298992360ed3b6c7bba88126dd45
I20260808 09:57:50.414186 25620 heartbeater.cc:347] Connected to a master server at 127.24.71.254:39419
I20260808 09:57:50.414333 25620 heartbeater.cc:464] Registering TS with master...
I20260808 09:57:50.414559 25620 heartbeater.cc:511] Master 127.24.71.254:39419 requested a full tablet report, sending...
I20260808 09:57:50.415069 24939 ts_manager.cc:194] Registered new tserver with Master: dec3f5575de64b059816db4ae66786e1 (127.24.71.195:41601)
I20260808 09:57:50.415556 24939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:46299
I20260808 09:57:50.426433 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 09:57:50 dist-test-slave-gw5c krb5kdc[24873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183070, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 09:57:50 dist-test-slave-gw5c krb5kdc[24873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183070, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.71.193@KRBTEST.COM
I20260808 09:57:50.452131 25629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:50.443921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36972 (local address 127.24.71.193:41633)
0808 09:57:50.444092 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:50.444096 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:50.444108 (+ 12us) server_negotiation.cc:407] Connection header received
0808 09:57:50.444135 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:50.444137 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:50.444150 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:50.444219 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:50.444903 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.445707 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.446765 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.447092 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.447149 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:50.449391 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:50.449401 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:50.449401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:50.449409 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:50.450797 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:50.451179 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:50.451183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:50.451183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:50.451247 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:50.451549 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:50.451550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:50.451550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:50.451695 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:50.451860 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:50.451911 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 09:57:50.452003 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
W20260808 09:57:50.452503 25090 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36972
Aug 08 09:57:50 dist-test-slave-gw5c krb5kdc[24873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 09:57:50 dist-test-slave-gw5c krb5kdc[24873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.193@KRBTEST.COM
I20260808 09:57:50.476608 25629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:50.469262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36982 (local address 127.24.71.193:41633)
0808 09:57:50.469349 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:50.469351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:50.469419 (+ 68us) server_negotiation.cc:407] Connection header received
0808 09:57:50.469488 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:50.469489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:50.469502 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:50.469546 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:50.470089 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.470577 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.471300 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:50.471581 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:50.471637 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:50.474006 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:50.474008 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:50.474008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:50.474015 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:50.475369 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:50.475801 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:50.475803 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:50.475803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:50.475863 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:50.476071 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:50.476072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:50.476072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:50.476177 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:50.476314 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:50.476398 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 09:57:50.476497 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 09:57:50.477324 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 25025
I20260808 09:57:50.492905 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 25229
I20260808 09:57:50.506392 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 25427
I20260808 09:57:50.520876 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 24890
2026-08-08T09:57:50Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2274 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:57:50 dist-test-slave-gw5c krb5kdc[25646](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:57:50 dist-test-slave-gw5c krb5kdc[25646](info): set up 2 sockets
Aug 08 09:57:50 dist-test-slave-gw5c krb5kdc[25646](info): commencing operation
krb5kdc: starting...
W20260808 09:57:51.761521 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:57:51 dist-test-slave-gw5c krb5kdc[25646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:57:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:57:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:57:51.886883 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:41819
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:41819
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:51.969318 25663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:51.969527 25663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:51.969549 25663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:51.970695 25663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:57:51.970739 25663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:51.970753 25663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:51.970767 25663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:57:51.970779 25663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:57:51.972344 25663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:41819
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:41819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:51.972605 25663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:51.972849 25663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:51.978070 25673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:51.978041 25670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:51.978155 25663 server_base.cc:1034] running on GCE node
W20260808 09:57:51.978140 25671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:51.978582 25663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:51.978931 25663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:51.980115 25663 hybrid_clock.cc:648] HybridClock initialized: now 1786183071980096 us; error 43 us; skew 500 ppm
Aug 08 09:57:51 dist-test-slave-gw5c krb5kdc[25646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183071, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:51.982683 25663 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:57:51.983201 25663 webserver.cc:460] Webserver started at http://127.24.71.254:33365/ using document root <none> and password file <none>
I20260808 09:57:51.983516 25663 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:51.983589 25663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:51.983732 25663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:51.984820 25663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "1afd8b35bc4f483e82ca45758eee1b1f"
format_stamp: "Formatted at 2026-08-08 09:57:51 on dist-test-slave-gw5c"
server_key: "488af243e6a136ae199d81c7423b2938"
server_key_iv: "8ec31e184b83a156d0791ca4f44390f9"
server_key_version: "encryptionkey@0"
I20260808 09:57:51.985215 25663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "1afd8b35bc4f483e82ca45758eee1b1f"
format_stamp: "Formatted at 2026-08-08 09:57:51 on dist-test-slave-gw5c"
server_key: "488af243e6a136ae199d81c7423b2938"
server_key_iv: "8ec31e184b83a156d0791ca4f44390f9"
server_key_version: "encryptionkey@0"
I20260808 09:57:51.986620 25663 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 09:57:51.987383 25684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:51.987600 25663 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:57:51.987705 25663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "1afd8b35bc4f483e82ca45758eee1b1f"
format_stamp: "Formatted at 2026-08-08 09:57:51 on dist-test-slave-gw5c"
server_key: "488af243e6a136ae199d81c7423b2938"
server_key_iv: "8ec31e184b83a156d0791ca4f44390f9"
server_key_version: "encryptionkey@0"
I20260808 09:57:51.987794 25663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:52.001024 25663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:52.002938 25663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:52.003113 25663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:52.007542 25663 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:41819
I20260808 09:57:52.007580 25752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:41819 every 8 connection(s)
I20260808 09:57:52.007954 25663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:57:52.008877 25753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:52.011147 25753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f: Bootstrap starting.
I20260808 09:57:52.011826 25753 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:52.012073 25753 log.cc:824] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f: Log is configured to *not* fsync() on all Append() calls
I20260808 09:57:52.012528 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 25663
I20260808 09:57:52.012626 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:57:52.012789 24863 external_mini_cluster.cc:1428] Setting key 62a0d869cc8b1c8433b7abed68110312
I20260808 09:57:52.012883 25753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f: No bootstrap required, opened a new log
I20260808 09:57:52.015146 25753 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1afd8b35bc4f483e82ca45758eee1b1f" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41819 } }
I20260808 09:57:52.015353 25753 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:52.015427 25753 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1afd8b35bc4f483e82ca45758eee1b1f, State: Initialized, Role: FOLLOWER
I20260808 09:57:52.015627 25753 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1afd8b35bc4f483e82ca45758eee1b1f" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41819 } }
I20260808 09:57:52.015748 25753 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:57:52.015792 25753 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:57:52.015843 25753 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:52.016624 25753 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1afd8b35bc4f483e82ca45758eee1b1f" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41819 } }
I20260808 09:57:52.016736 25753 leader_election.cc:302] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1afd8b35bc4f483e82ca45758eee1b1f; no voters:
I20260808 09:57:52.016887 25753 leader_election.cc:288] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:57:52.016928 25760 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:57:52.017131 25760 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [term 1 LEADER]: Becoming Leader. State: Replica: 1afd8b35bc4f483e82ca45758eee1b1f, State: Running, Role: LEADER
I20260808 09:57:52.017182 25753 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:57:52.017244 25760 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1afd8b35bc4f483e82ca45758eee1b1f" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41819 } }
I20260808 09:57:52.017802 25761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1afd8b35bc4f483e82ca45758eee1b1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1afd8b35bc4f483e82ca45758eee1b1f" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41819 } } }
I20260808 09:57:52.017791 25760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1afd8b35bc4f483e82ca45758eee1b1f. Latest consensus state: current_term: 1 leader_uuid: "1afd8b35bc4f483e82ca45758eee1b1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1afd8b35bc4f483e82ca45758eee1b1f" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41819 } } }
I20260808 09:57:52.017927 25760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [sys.catalog]: This master's current role is: LEADER
I20260808 09:57:52.017921 25761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f [sys.catalog]: This master's current role is: LEADER
I20260808 09:57:52.018754 25779 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:57:52.019631 25779 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:57:52.022399 25779 catalog_manager.cc:1347] Generated new cluster ID: 021e12c90f8d4143a296d140b58198c4
I20260808 09:57:52.022465 25779 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[25646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:52.027637 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.013343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48374 (local address 127.24.71.254:41819)
0808 09:57:52.013567 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:52.013578 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:52.013617 (+ 39us) server_negotiation.cc:407] Connection header received
0808 09:57:52.014368 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:52.014378 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:52.014445 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:52.014611 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:52.015227 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.017166 (+ 1939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.019522 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.020601 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.020770 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.023790 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:52.023794 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:52.023795 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:52.023806 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:52.025915 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.026340 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.026343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.026344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.026453 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.026676 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.026677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.026677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.026969 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:52.027114 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:52.027241 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 09:57:52.027382 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":86,"threads_started":1}
I20260808 09:57:52.031750 25779 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:57:52.032262 25779 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:57:52.040558 25779 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1afd8b35bc4f483e82ca45758eee1b1f: Generated new TSK 0
I20260808 09:57:52.040746 25779 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 09:57:52.074558 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:41819
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:52.157665 25801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:52.157910 25801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:52.157951 25801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:52.159142 25801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:52.159217 25801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:52.159266 25801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:57:52.161329 25801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:41819
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:52.161652 25801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:52.161904 25801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:52.166955 25811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:52.166966 25806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:52.166960 25807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:52.167243 25801 server_base.cc:1034] running on GCE node
I20260808 09:57:52.167537 25801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:52.167793 25801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:52.168958 25801 hybrid_clock.cc:648] HybridClock initialized: now 1786183072168942 us; error 29 us; skew 500 ppm
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[25646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183072, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:52.171639 25801 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 09:57:52.172152 25801 webserver.cc:460] Webserver started at http://127.24.71.193:41789/ using document root <none> and password file <none>
I20260808 09:57:52.172394 25801 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:52.172472 25801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:52.172619 25801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:52.173699 25801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "bb9dbda5d4114a88abef9e8bd543d3b0"
format_stamp: "Formatted at 2026-08-08 09:57:52 on dist-test-slave-gw5c"
server_key: "87b5b1b8bf14a636f55c3b294962ae91"
server_key_iv: "9c590654c89b8324097aee7eca72cba9"
server_key_version: "encryptionkey@0"
I20260808 09:57:52.174088 25801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "bb9dbda5d4114a88abef9e8bd543d3b0"
format_stamp: "Formatted at 2026-08-08 09:57:52 on dist-test-slave-gw5c"
server_key: "87b5b1b8bf14a636f55c3b294962ae91"
server_key_iv: "9c590654c89b8324097aee7eca72cba9"
server_key_version: "encryptionkey@0"
I20260808 09:57:52.175535 25801 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260808 09:57:52.176303 25820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:52.176481 25801 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:57:52.176594 25801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "bb9dbda5d4114a88abef9e8bd543d3b0"
format_stamp: "Formatted at 2026-08-08 09:57:52 on dist-test-slave-gw5c"
server_key: "87b5b1b8bf14a636f55c3b294962ae91"
server_key_iv: "9c590654c89b8324097aee7eca72cba9"
server_key_version: "encryptionkey@0"
I20260808 09:57:52.176684 25801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:52.198710 25801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:52.200760 25801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:52.200941 25801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:52.201189 25801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:57:52.201517 25801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:57:52.201575 25801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:52.201622 25801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:57:52.201654 25801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:52.207573 25801 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:43851
I20260808 09:57:52.207633 25997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:43851 every 8 connection(s)
I20260808 09:57:52.207949 25801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 09:57:52.210705 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 25801
I20260808 09:57:52.210803 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:57:52.210963 24863 external_mini_cluster.cc:1428] Setting key ad9f9b92953e8c1cdf761103634884bb
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[25646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183072, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:52.218932 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.208645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:55779 (local address 127.24.71.254:41819)
0808 09:57:52.208739 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:52.208742 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:52.208939 (+ 197us) server_negotiation.cc:407] Connection header received
0808 09:57:52.209984 (+ 1045us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:52.209985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:52.209996 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:52.210050 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:52.210668 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.211527 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.213141 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.213351 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.213456 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.215935 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:52.215937 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:52.215937 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:52.215945 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:52.217416 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.217866 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.217867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.217868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.217969 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.218235 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.218237 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.218237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.218361 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:52.218443 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:52.218723 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 09:57:52.218815 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 09:57:52.219151 26001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.208614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41819 (local address 127.24.71.193:55779)
0808 09:57:52.208809 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:52.208847 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:52.209875 (+ 1028us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:52.210104 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:52.210107 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:52.210366 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:52.210571 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.210575 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.211692 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.211693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.213040 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.213044 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.213487 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.213488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.213662 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.214234 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:52.214242 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:52.215834 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:52.217510 (+ 1676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:52.217517 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:52.217519 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:52.217752 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:52.218045 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:52.218046 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:52.218047 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:52.218167 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:52.218437 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:52.218445 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:52.218588 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 09:57:52.218691 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 09:57:52.218852 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":112,"threads_started":1}
I20260808 09:57:52.219681 25998 heartbeater.cc:347] Connected to a master server at 127.24.71.254:41819
I20260808 09:57:52.219806 25998 heartbeater.cc:464] Registering TS with master...
I20260808 09:57:52.220033 25998 heartbeater.cc:511] Master 127.24.71.254:41819 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
I20260808 09:57:52.220664 25704 ts_manager.cc:194] Registered new tserver with Master: bb9dbda5d4114a88abef9e8bd543d3b0 (127.24.71.193:43851)
I20260808 09:57:52.221393 25704 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:55779
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 09:57:52.239264 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:41819
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:52.322966 26006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:52.323172 26006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:52.323196 26006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:52.324294 26006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:52.324334 26006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:52.324360 26006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:57:52.325791 26006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:41819
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:52.325991 26006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:52.326169 26006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:52.331073 26011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:52.331090 26015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:52.331125 26013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:52.331353 26006 server_base.cc:1034] running on GCE node
I20260808 09:57:52.331588 26006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:52.331830 26006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:52.332971 26006 hybrid_clock.cc:648] HybridClock initialized: now 1786183072332957 us; error 46 us; skew 500 ppm
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[25646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183072, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:52.335652 26006 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 09:57:52.336081 26006 webserver.cc:460] Webserver started at http://127.24.71.194:34031/ using document root <none> and password file <none>
I20260808 09:57:52.336304 26006 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:52.336345 26006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:52.336457 26006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:52.337467 26006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "856bad1aa39c4b9490adb0ee6a097a5d"
format_stamp: "Formatted at 2026-08-08 09:57:52 on dist-test-slave-gw5c"
server_key: "1bc6b26073d69bfd08f1496a3ed1999a"
server_key_iv: "eaabc916bb910acc2a1ca409a99d966f"
server_key_version: "encryptionkey@0"
I20260808 09:57:52.337772 26006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "856bad1aa39c4b9490adb0ee6a097a5d"
format_stamp: "Formatted at 2026-08-08 09:57:52 on dist-test-slave-gw5c"
server_key: "1bc6b26073d69bfd08f1496a3ed1999a"
server_key_iv: "eaabc916bb910acc2a1ca409a99d966f"
server_key_version: "encryptionkey@0"
I20260808 09:57:52.339143 26006 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 09:57:52.339902 26023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:52.340097 26006 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:52.340171 26006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "856bad1aa39c4b9490adb0ee6a097a5d"
format_stamp: "Formatted at 2026-08-08 09:57:52 on dist-test-slave-gw5c"
server_key: "1bc6b26073d69bfd08f1496a3ed1999a"
server_key_iv: "eaabc916bb910acc2a1ca409a99d966f"
server_key_version: "encryptionkey@0"
I20260808 09:57:52.340263 26006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:52.357683 26006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:52.360250 26006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:52.360422 26006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:52.360702 26006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:57:52.361080 26006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:57:52.361137 26006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:52.361169 26006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:57:52.361199 26006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:52.371438 26006 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:40351
I20260808 09:57:52.371479 26184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:40351 every 8 connection(s)
I20260808 09:57:52.371906 26006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:57:52.375061 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 26006
I20260808 09:57:52.375133 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:57:52.375308 24863 external_mini_cluster.cc:1428] Setting key 31ec984a59fcb1d722db634014fbb3b0
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[25646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183072, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:52.382499 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.372713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:36363 (local address 127.24.71.254:41819)
0808 09:57:52.372766 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:52.372769 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:52.373050 (+ 281us) server_negotiation.cc:407] Connection header received
0808 09:57:52.373977 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:52.373978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:52.373988 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:52.374039 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:52.374753 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.375320 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.376375 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.376595 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.376673 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.379152 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:52.379154 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:52.379154 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:52.379163 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:52.380943 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.381412 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.381413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.381414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.381485 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.381750 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.381751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.381752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.381923 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:52.382000 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:52.382262 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 09:57:52.382371 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 09:57:52.382566 26190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.372694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41819 (local address 127.24.71.194:36363)
0808 09:57:52.372880 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:52.372928 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:52.373879 (+ 951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:52.374107 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:52.374111 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:52.374445 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:52.374674 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.374679 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.375462 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.375463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.376275 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.376277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.376679 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.376681 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.376810 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.377379 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:52.377387 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:52.379053 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:52.381045 (+ 1992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:52.381052 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:52.381053 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:52.381327 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:52.381560 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:52.381561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:52.381561 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:52.381679 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:52.382000 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:52.382005 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:52.382121 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 09:57:52.382209 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 09:57:52.382365 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
I20260808 09:57:52.383064 26187 heartbeater.cc:347] Connected to a master server at 127.24.71.254:41819
I20260808 09:57:52.383224 26187 heartbeater.cc:464] Registering TS with master...
I20260808 09:57:52.383478 26187 heartbeater.cc:511] Master 127.24.71.254:41819 requested a full tablet report, sending...
I20260808 09:57:52.383965 25704 ts_manager.cc:194] Registered new tserver with Master: 856bad1aa39c4b9490adb0ee6a097a5d (127.24.71.194:40351)
I20260808 09:57:52.384364 25704 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:36363
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 09:57:52.405866 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:41819
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:52.489760 26197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:52.490037 26197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:52.490068 26197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:52.491437 26197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:52.491480 26197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:52.491509 26197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:57:52.493101 26197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:41819
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:52.493294 26197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:52.493497 26197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:52.498497 26209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:52.498493 26206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:52.498593 26197 server_base.cc:1034] running on GCE node
W20260808 09:57:52.498558 26203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:52.499020 26197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:52.499239 26197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:52.500413 26197 hybrid_clock.cc:648] HybridClock initialized: now 1786183072500415 us; error 43 us; skew 500 ppm
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[25646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183072, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:52.503050 26197 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 09:57:52.503582 26197 webserver.cc:460] Webserver started at http://127.24.71.195:36379/ using document root <none> and password file <none>
I20260808 09:57:52.503834 26197 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:52.503904 26197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:52.504063 26197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:52.505154 26197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23"
format_stamp: "Formatted at 2026-08-08 09:57:52 on dist-test-slave-gw5c"
server_key: "892d51e7d9ec74d37f9774e315e73463"
server_key_iv: "aaa5c49ae99fc6989ff4b3342edb5fb6"
server_key_version: "encryptionkey@0"
I20260808 09:57:52.505541 26197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23"
format_stamp: "Formatted at 2026-08-08 09:57:52 on dist-test-slave-gw5c"
server_key: "892d51e7d9ec74d37f9774e315e73463"
server_key_iv: "aaa5c49ae99fc6989ff4b3342edb5fb6"
server_key_version: "encryptionkey@0"
I20260808 09:57:52.506961 26197 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:57:52.507848 26219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:52.508069 26197 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 09:57:52.508178 26197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23"
format_stamp: "Formatted at 2026-08-08 09:57:52 on dist-test-slave-gw5c"
server_key: "892d51e7d9ec74d37f9774e315e73463"
server_key_iv: "aaa5c49ae99fc6989ff4b3342edb5fb6"
server_key_version: "encryptionkey@0"
I20260808 09:57:52.508256 26197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:52.521445 26197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:52.523648 26197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:52.523818 26197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:52.524071 26197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:57:52.524398 26197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:57:52.524459 26197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:52.524523 26197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:57:52.524554 26197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:52.530845 26197 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:44435
I20260808 09:57:52.530891 26399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:44435 every 8 connection(s)
I20260808 09:57:52.531231 26197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:57:52.531610 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 26197
I20260808 09:57:52.531703 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:57:52.531883 24863 external_mini_cluster.cc:1428] Setting key a3077bcdf3c65ef955bd5ec93fcd1e49
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[25646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183072, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:52.541157 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.532052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:35349 (local address 127.24.71.254:41819)
0808 09:57:52.532130 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:52.532132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:52.532437 (+ 305us) server_negotiation.cc:407] Connection header received
0808 09:57:52.533521 (+ 1084us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:52.533522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:52.533537 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:52.533585 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:52.534246 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.534787 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.535932 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.536145 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.536227 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.538399 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:52.538401 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:52.538401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:52.538408 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:52.539772 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.540161 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.540162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.540162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.540217 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.540485 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.540486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.540486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.540637 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:52.540717 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:52.541010 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 09:57:52.541090 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 09:57:52.541426 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.532043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41819 (local address 127.24.71.195:35349)
0808 09:57:52.532311 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:52.532359 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:52.533400 (+ 1041us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:52.533657 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:52.533661 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:52.533951 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:52.534151 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.534156 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.534902 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.534903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.535832 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.535834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.536233 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.536234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.536377 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.536877 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:52.536886 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:52.538293 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:52.539844 (+ 1551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:52.539850 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:52.539852 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:52.540089 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:52.540277 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:52.540278 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:52.540278 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:52.540419 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:52.540722 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:52.540728 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:52.540858 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 09:57:52.540984 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 09:57:52.541158 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":89,"threads_started":1}
I20260808 09:57:52.542008 26400 heartbeater.cc:347] Connected to a master server at 127.24.71.254:41819
I20260808 09:57:52.542127 26400 heartbeater.cc:464] Registering TS with master...
I20260808 09:57:52.542313 26400 heartbeater.cc:511] Master 127.24.71.254:41819 requested a full tablet report, sending...
I20260808 09:57:52.542742 25704 ts_manager.cc:194] Registered new tserver with Master: ddaa1d9b88f54b9fa1a5cd530b049e23 (127.24.71.195:44435)
I20260808 09:57:52.543150 25704 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:35349
I20260808 09:57:52.543705 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 09:57:52.551105 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.545281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48388 (local address 127.24.71.254:41819)
0808 09:57:52.545326 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:52.545328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:52.545480 (+ 152us) server_negotiation.cc:407] Connection header received
0808 09:57:52.545539 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:52.545540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:52.545548 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:52.545594 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:52.546083 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.546533 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.547192 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.547365 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.547503 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.549011 (+ 1508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:52.549013 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:52.549013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:52.549019 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:52.550148 (+ 1129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.550461 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.550462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.550462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.550519 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.550684 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.550684 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.550684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.550816 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:52.550891 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:52.550988 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 09:57:52.551044 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 09:57:52.553157 25704 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48388:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:57:52.554780 25704 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:57:52.561792 26424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.557474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58406 (local address 127.24.71.194:40351)
0808 09:57:52.557942 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:52.557946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:52.557957 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:57:52.557999 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:52.558000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:52.558016 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:52.558095 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:52.558319 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.559469 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.560673 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.561394 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.561476 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.561536 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:52.561668 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 09:57:52.561710 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":93,"threads_started":1}
I20260808 09:57:52.562054 26428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.557705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55456 (local address 127.24.71.193:43851)
0808 09:57:52.557914 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:52.557921 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:52.557935 (+ 14us) server_negotiation.cc:407] Connection header received
0808 09:57:52.558020 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:52.558022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:52.558038 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:52.558111 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:52.558365 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.559190 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.560839 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.561559 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.561646 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.561700 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:52.561929 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 09:57:52.561982 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":96,"threads_started":1}
I20260808 09:57:52.562172 26426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.557591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:43851 (local address 127.0.0.1:55456)
0808 09:57:52.557897 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:52.557906 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:52.557944 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:52.558207 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:52.558208 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:52.558210 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:52.558284 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.558286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.559285 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.559287 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.560754 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.560757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.561646 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.561647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.561708 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.561711 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:57:52.561762 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 09:57:52.561797 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":4,"thread_start_us":70,"threads_started":1}
I20260808 09:57:52.561800 26419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.557371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:40351 (local address 127.0.0.1:58406)
0808 09:57:52.557673 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:52.557717 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:52.557793 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:52.558182 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:52.558182 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:52.558184 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:52.558236 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.558238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.559590 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.559591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.560575 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.560578 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.561485 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.561486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.561543 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.561554 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 09:57:52.561647 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 09:57:52.561705 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":34,"thread_start_us":60,"threads_started":1}
I20260808 09:57:52.562738 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.557388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:44435 (local address 127.0.0.1:50386)
0808 09:57:52.557673 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:52.557716 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:52.557781 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:52.558164 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:52.558167 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:52.558170 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:52.558241 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.558242 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.559595 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.559596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.560755 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.560757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.562508 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.562509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.562571 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.562575 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:57:52.562631 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 09:57:52.562674 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":31,"thread_start_us":100,"threads_started":1}
I20260808 09:57:52.563052 25892 tablet_service.cc:1467] Processing CreateTablet for tablet 6ca12bbcdb5e4027986d7bf0928af5b6 (DEFAULT_TABLE table=test-table [id=faf7632894ea4b24b700f8a087be9eb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:52.563088 26084 tablet_service.cc:1467] Processing CreateTablet for tablet 6ca12bbcdb5e4027986d7bf0928af5b6 (DEFAULT_TABLE table=test-table [id=faf7632894ea4b24b700f8a087be9eb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:52.563381 26084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ca12bbcdb5e4027986d7bf0928af5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:52.563449 25892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ca12bbcdb5e4027986d7bf0928af5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:52.566236 26429 tablet_bootstrap.cc:492] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0: Bootstrap starting.
I20260808 09:57:52.566510 26430 tablet_bootstrap.cc:492] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d: Bootstrap starting.
I20260808 09:57:52.566648 26425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.557499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50386 (local address 127.24.71.195:44435)
0808 09:57:52.557967 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:52.557971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:52.557980 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:57:52.558015 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:52.558017 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:52.558055 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:52.558316 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:52.558395 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.559485 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.561736 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.562395 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.562506 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.562567 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:52.566518 (+ 3951us) server_negotiation.cc:299] Negotiation successful
0808 09:57:52.566560 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":77,"threads_started":1}
I20260808 09:57:52.567216 26429 tablet_bootstrap.cc:654] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:52.567216 26430 tablet_bootstrap.cc:654] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:52.567294 26297 tablet_service.cc:1467] Processing CreateTablet for tablet 6ca12bbcdb5e4027986d7bf0928af5b6 (DEFAULT_TABLE table=test-table [id=faf7632894ea4b24b700f8a087be9eb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:52.567662 26297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ca12bbcdb5e4027986d7bf0928af5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:52.567895 26429 log.cc:824] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0: Log is configured to *not* fsync() on all Append() calls
I20260808 09:57:52.567894 26430 log.cc:824] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d: Log is configured to *not* fsync() on all Append() calls
I20260808 09:57:52.568701 26429 tablet_bootstrap.cc:492] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0: No bootstrap required, opened a new log
I20260808 09:57:52.568778 26429 ts_tablet_manager.cc:1397] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 09:57:52.568912 26430 tablet_bootstrap.cc:492] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d: No bootstrap required, opened a new log
I20260808 09:57:52.568991 26430 ts_tablet_manager.cc:1397] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 09:57:52.570959 26434 tablet_bootstrap.cc:492] T 6ca12bbcdb5e4027986d7bf0928af5b6 P ddaa1d9b88f54b9fa1a5cd530b049e23: Bootstrap starting.
I20260808 09:57:52.570997 26430 raft_consensus.cc:348] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40351 } } peers { permanent_uuid: "bb9dbda5d4114a88abef9e8bd543d3b0" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43851 } } peers { permanent_uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 44435 } }
I20260808 09:57:52.570997 26429 raft_consensus.cc:348] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40351 } } peers { permanent_uuid: "bb9dbda5d4114a88abef9e8bd543d3b0" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43851 } } peers { permanent_uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 44435 } }
I20260808 09:57:52.571198 26430 raft_consensus.cc:374] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:52.571198 26429 raft_consensus.cc:374] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:52.571238 26430 raft_consensus.cc:729] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 856bad1aa39c4b9490adb0ee6a097a5d, State: Initialized, Role: FOLLOWER
I20260808 09:57:52.571238 26429 raft_consensus.cc:729] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb9dbda5d4114a88abef9e8bd543d3b0, State: Initialized, Role: FOLLOWER
I20260808 09:57:52.571380 26430 consensus_queue.cc:260] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40351 } } peers { permanent_uuid: "bb9dbda5d4114a88abef9e8bd543d3b0" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43851 } } peers { permanent_uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 44435 } }
I20260808 09:57:52.571380 26429 consensus_queue.cc:260] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40351 } } peers { permanent_uuid: "bb9dbda5d4114a88abef9e8bd543d3b0" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43851 } } peers { permanent_uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 44435 } }
I20260808 09:57:52.571720 26434 tablet_bootstrap.cc:654] T 6ca12bbcdb5e4027986d7bf0928af5b6 P ddaa1d9b88f54b9fa1a5cd530b049e23: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:52.571712 25998 heartbeater.cc:503] Master 127.24.71.254:41819 was elected leader, sending a full tablet report...
I20260808 09:57:52.571755 26430 ts_tablet_manager.cc:1428] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260808 09:57:52.571885 26187 heartbeater.cc:503] Master 127.24.71.254:41819 was elected leader, sending a full tablet report...
I20260808 09:57:52.571707 26429 ts_tablet_manager.cc:1428] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 09:57:52.572335 26434 log.cc:824] T 6ca12bbcdb5e4027986d7bf0928af5b6 P ddaa1d9b88f54b9fa1a5cd530b049e23: Log is configured to *not* fsync() on all Append() calls
I20260808 09:57:52.573213 26434 tablet_bootstrap.cc:492] T 6ca12bbcdb5e4027986d7bf0928af5b6 P ddaa1d9b88f54b9fa1a5cd530b049e23: No bootstrap required, opened a new log
I20260808 09:57:52.573273 26434 ts_tablet_manager.cc:1397] T 6ca12bbcdb5e4027986d7bf0928af5b6 P ddaa1d9b88f54b9fa1a5cd530b049e23: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 09:57:52.574836 26434 raft_consensus.cc:348] T 6ca12bbcdb5e4027986d7bf0928af5b6 P ddaa1d9b88f54b9fa1a5cd530b049e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40351 } } peers { permanent_uuid: "bb9dbda5d4114a88abef9e8bd543d3b0" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43851 } } peers { permanent_uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 44435 } }
I20260808 09:57:52.574975 26434 raft_consensus.cc:374] T 6ca12bbcdb5e4027986d7bf0928af5b6 P ddaa1d9b88f54b9fa1a5cd530b049e23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:52.574998 26434 raft_consensus.cc:729] T 6ca12bbcdb5e4027986d7bf0928af5b6 P ddaa1d9b88f54b9fa1a5cd530b049e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddaa1d9b88f54b9fa1a5cd530b049e23, State: Initialized, Role: FOLLOWER
I20260808 09:57:52.575145 26434 consensus_queue.cc:260] T 6ca12bbcdb5e4027986d7bf0928af5b6 P ddaa1d9b88f54b9fa1a5cd530b049e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40351 } } peers { permanent_uuid: "bb9dbda5d4114a88abef9e8bd543d3b0" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43851 } } peers { permanent_uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 44435 } }
I20260808 09:57:52.575448 26434 ts_tablet_manager.cc:1428] T 6ca12bbcdb5e4027986d7bf0928af5b6 P ddaa1d9b88f54b9fa1a5cd530b049e23: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 09:57:52.575453 26400 heartbeater.cc:503] Master 127.24.71.254:41819 was elected leader, sending a full tablet report...
W20260808 09:57:52.623720 26188 tablet.cc:2369] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 09:57:52.625631 26436 raft_consensus.cc:482] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:57:52.625787 26436 raft_consensus.cc:504] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40351 } } peers { permanent_uuid: "bb9dbda5d4114a88abef9e8bd543d3b0" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43851 } } peers { permanent_uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 44435 } }
I20260808 09:57:52.626240 26436 leader_election.cc:288] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb9dbda5d4114a88abef9e8bd543d3b0 (127.24.71.193:43851), ddaa1d9b88f54b9fa1a5cd530b049e23 (127.24.71.195:44435)
I20260808 09:57:52.630167 26425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.626483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:58835 (local address 127.24.71.195:44435)
0808 09:57:52.626548 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:52.626549 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:52.626683 (+ 134us) server_negotiation.cc:407] Connection header received
0808 09:57:52.626732 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:52.626733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:52.626742 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:52.626795 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:52.627003 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.627604 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.629217 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.629736 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.629815 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.629827 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:52.630039 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 09:57:52.630094 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 09:57:52.630192 26190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.626436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:43851 (local address 127.24.71.194:40465)
0808 09:57:52.626504 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:52.626515 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:52.626563 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:52.626804 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:52.626806 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:52.626808 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:52.626887 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.626889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.627738 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.627739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.629098 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.629100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.629945 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.629946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.630032 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.630034 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 09:57:52.630087 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 09:57:52.630125 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":96}
I20260808 09:57:52.630252 26428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.626497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:40465 (local address 127.24.71.193:43851)
0808 09:57:52.626546 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:52.626548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:52.626561 (+ 13us) server_negotiation.cc:407] Connection header received
0808 09:57:52.626643 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:52.626644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:52.626652 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:52.626745 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:52.626965 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.627652 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.629202 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.629857 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.629952 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.629962 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:52.630109 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 09:57:52.630153 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 09:57:52.630424 26439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.626437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:44435 (local address 127.24.71.194:58835)
0808 09:57:52.626614 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:52.626622 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:52.626674 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:52.626803 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:52.626803 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:52.626806 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:52.626897 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.626899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.627686 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.627687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.629098 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:52.629100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.629868 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.629869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:52.629947 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.629951 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:57:52.630268 (+ 317us) client_negotiation.cc:240] Negotiation successful
0808 09:57:52.630317 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":110,"thread_start_us":94,"threads_started":1}
I20260808 09:57:52.630832 26337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ca12bbcdb5e4027986d7bf0928af5b6" candidate_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23" is_pre_election: true
I20260808 09:57:52.631019 26337 raft_consensus.cc:2454] T 6ca12bbcdb5e4027986d7bf0928af5b6 P ddaa1d9b88f54b9fa1a5cd530b049e23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 856bad1aa39c4b9490adb0ee6a097a5d in term 0.
I20260808 09:57:52.631035 25919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ca12bbcdb5e4027986d7bf0928af5b6" candidate_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb9dbda5d4114a88abef9e8bd543d3b0" is_pre_election: true
I20260808 09:57:52.631183 25919 raft_consensus.cc:2454] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 856bad1aa39c4b9490adb0ee6a097a5d in term 0.
I20260808 09:57:52.631291 26029 leader_election.cc:302] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 856bad1aa39c4b9490adb0ee6a097a5d, ddaa1d9b88f54b9fa1a5cd530b049e23; no voters:
I20260808 09:57:52.631469 26436 raft_consensus.cc:2781] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:57:52.631531 26436 raft_consensus.cc:482] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:57:52.631561 26436 raft_consensus.cc:3037] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:52.632591 26436 raft_consensus.cc:504] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40351 } } peers { permanent_uuid: "bb9dbda5d4114a88abef9e8bd543d3b0" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43851 } } peers { permanent_uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 44435 } }
I20260808 09:57:52.632758 26436 leader_election.cc:288] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [CANDIDATE]: Term 1 election: Requested vote from peers bb9dbda5d4114a88abef9e8bd543d3b0 (127.24.71.193:43851), ddaa1d9b88f54b9fa1a5cd530b049e23 (127.24.71.195:44435)
I20260808 09:57:52.632982 26337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ca12bbcdb5e4027986d7bf0928af5b6" candidate_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23"
I20260808 09:57:52.633021 25919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ca12bbcdb5e4027986d7bf0928af5b6" candidate_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb9dbda5d4114a88abef9e8bd543d3b0"
I20260808 09:57:52.633101 25919 raft_consensus.cc:3037] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:52.633098 26337 raft_consensus.cc:3037] T 6ca12bbcdb5e4027986d7bf0928af5b6 P ddaa1d9b88f54b9fa1a5cd530b049e23 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:52.634056 25919 raft_consensus.cc:2454] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 856bad1aa39c4b9490adb0ee6a097a5d in term 1.
I20260808 09:57:52.634235 26337 raft_consensus.cc:2454] T 6ca12bbcdb5e4027986d7bf0928af5b6 P ddaa1d9b88f54b9fa1a5cd530b049e23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 856bad1aa39c4b9490adb0ee6a097a5d in term 1.
I20260808 09:57:52.634241 26024 leader_election.cc:302] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 856bad1aa39c4b9490adb0ee6a097a5d, bb9dbda5d4114a88abef9e8bd543d3b0; no voters:
I20260808 09:57:52.634457 26436 raft_consensus.cc:2781] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:57:52.634637 26436 raft_consensus.cc:686] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [term 1 LEADER]: Becoming Leader. State: Replica: 856bad1aa39c4b9490adb0ee6a097a5d, State: Running, Role: LEADER
I20260808 09:57:52.634752 26436 consensus_queue.cc:237] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40351 } } peers { permanent_uuid: "bb9dbda5d4114a88abef9e8bd543d3b0" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43851 } } peers { permanent_uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 44435 } }
I20260808 09:57:52.635656 25703 catalog_manager.cc:5495] T 6ca12bbcdb5e4027986d7bf0928af5b6 P 856bad1aa39c4b9490adb0ee6a097a5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 856bad1aa39c4b9490adb0ee6a097a5d (127.24.71.194). New cstate: current_term: 1 leader_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "856bad1aa39c4b9490adb0ee6a097a5d" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb9dbda5d4114a88abef9e8bd543d3b0" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddaa1d9b88f54b9fa1a5cd530b049e23" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 44435 } health_report { overall_health: UNKNOWN } } }
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[25646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.193@KRBTEST.COM
I20260808 09:57:52.663904 26428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.653379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55470 (local address 127.24.71.193:43851)
0808 09:57:52.653438 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:52.653440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:52.653538 (+ 98us) server_negotiation.cc:407] Connection header received
0808 09:57:52.653626 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:52.653627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:52.653638 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:52.653685 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:52.654464 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.655322 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.656548 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.656901 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.657003 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.660237 (+ 3234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:52.660255 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:52.660255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:52.660265 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:52.662440 (+ 2175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.662804 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.662808 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.662808 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.662881 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.663069 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.663070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.663070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.663280 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:52.663483 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:52.663653 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 09:57:52.663754 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[25646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183072, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[25646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183072, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.71.193@KRBTEST.COM
I20260808 09:57:52.688865 26428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.681164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55472 (local address 127.24.71.193:43851)
0808 09:57:52.681264 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:52.681266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:52.681385 (+ 119us) server_negotiation.cc:407] Connection header received
0808 09:57:52.681453 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:52.681454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:52.681464 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:52.681505 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:52.682070 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.682547 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.683313 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.683673 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.683747 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.686343 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:52.686344 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:52.686344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:52.686351 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:52.687678 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.688049 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.688050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.688050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.688118 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.688324 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.688326 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.688326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.688445 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:52.688528 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:52.688679 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 09:57:52.688742 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[25646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
W20260808 09:57:52.708751 25999 tablet.cc:2369] T 6ca12bbcdb5e4027986d7bf0928af5b6 P bb9dbda5d4114a88abef9e8bd543d3b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[25646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.193@KRBTEST.COM
I20260808 09:57:52.714015 26428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:52.706355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55486 (local address 127.24.71.193:43851)
0808 09:57:52.706438 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:52.706441 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:52.706550 (+ 109us) server_negotiation.cc:407] Connection header received
0808 09:57:52.706631 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:52.706632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:52.706650 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:52.706720 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:52.707329 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.707870 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.708661 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:52.708894 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:52.708989 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:52.711438 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:52.711439 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:52.711439 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:52.711448 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:52.712826 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.713194 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.713196 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.713196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.713259 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:52.713459 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:52.713460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:52.713460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:52.713577 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:52.713676 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:52.713815 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 09:57:52.713898 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 09:57:52.714555 25863 tablet_service.cc:2908] Rejecting scan request for tablet 6ca12bbcdb5e4027986d7bf0928af5b6: Uninitialized: clean time has not yet been initialized
I20260808 09:57:52.715618 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 25801
I20260808 09:57:52.729990 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 26006
I20260808 09:57:52.739588 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 26197
I20260808 09:57:52.749969 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 25663
2026-08-08T09:57:52Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2228 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[26465](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[26465](info): set up 2 sockets
Aug 08 09:57:52 dist-test-slave-gw5c krb5kdc[26465](info): commencing operation
krb5kdc: starting...
W20260808 09:57:53.993212 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:57:54 dist-test-slave-gw5c krb5kdc[26465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:57:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:57:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:57:54.122802 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:37657
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:37657
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:54.208081 26484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:54.208336 26484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:54.208379 26484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:54.209548 26484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:57:54.209618 26484 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 09:57:54.209641 26484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:54.209663 26484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:54.209692 26484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:57:54.209717 26484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:57:54.211210 26484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:37657
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:37657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:54.211534 26484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:54.211777 26484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:54.216884 26489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:54.216884 26493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:54.216977 26491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:54.217047 26484 server_base.cc:1034] running on GCE node
I20260808 09:57:54.217429 26484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:54.217777 26484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:54.218964 26484 hybrid_clock.cc:648] HybridClock initialized: now 1786183074218941 us; error 40 us; skew 500 ppm
Aug 08 09:57:54 dist-test-slave-gw5c krb5kdc[26465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183074, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:54.224466 26484 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:57:54.224944 26484 webserver.cc:460] Webserver started at http://127.24.71.254:33295/ using document root <none> and password file <none>
I20260808 09:57:54.225189 26484 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:54.225261 26484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:54.225423 26484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:54.226553 26484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "be79c9d89f5141089fa12bc7df770efa"
format_stamp: "Formatted at 2026-08-08 09:57:54 on dist-test-slave-gw5c"
server_key: "22de1a6131c58ebfe2c9a206cdf13b21"
server_key_iv: "3693aaddd366c29c0b4e2f493b02970b"
server_key_version: "encryptionkey@0"
I20260808 09:57:54.226935 26484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "be79c9d89f5141089fa12bc7df770efa"
format_stamp: "Formatted at 2026-08-08 09:57:54 on dist-test-slave-gw5c"
server_key: "22de1a6131c58ebfe2c9a206cdf13b21"
server_key_iv: "3693aaddd366c29c0b4e2f493b02970b"
server_key_version: "encryptionkey@0"
I20260808 09:57:54.228471 26484 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 09:57:54.229246 26502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:54.229430 26484 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:57:54.229553 26484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "be79c9d89f5141089fa12bc7df770efa"
format_stamp: "Formatted at 2026-08-08 09:57:54 on dist-test-slave-gw5c"
server_key: "22de1a6131c58ebfe2c9a206cdf13b21"
server_key_iv: "3693aaddd366c29c0b4e2f493b02970b"
server_key_version: "encryptionkey@0"
I20260808 09:57:54.229635 26484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:54.246347 26484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:54.248404 26484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:54.248598 26484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:54.253947 26484 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:37657
I20260808 09:57:54.254012 26590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:37657 every 8 connection(s)
I20260808 09:57:54.254334 26484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:57:54.254958 26591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:54.257375 26591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa: Bootstrap starting.
I20260808 09:57:54.258020 26591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:54.258332 26591 log.cc:824] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa: Log is configured to *not* fsync() on all Append() calls
I20260808 09:57:54.258826 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 26484
I20260808 09:57:54.258942 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:57:54.259126 24863 external_mini_cluster.cc:1428] Setting key 08f4304b1befa495c8e3882ce7db110b
I20260808 09:57:54.259148 26591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa: No bootstrap required, opened a new log
I20260808 09:57:54.262085 26591 raft_consensus.cc:348] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be79c9d89f5141089fa12bc7df770efa" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37657 } }
I20260808 09:57:54.262223 26591 raft_consensus.cc:374] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:54.262247 26591 raft_consensus.cc:729] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be79c9d89f5141089fa12bc7df770efa, State: Initialized, Role: FOLLOWER
I20260808 09:57:54.262377 26591 consensus_queue.cc:260] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be79c9d89f5141089fa12bc7df770efa" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37657 } }
I20260808 09:57:54.262470 26591 raft_consensus.cc:388] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:57:54.262516 26591 raft_consensus.cc:482] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:57:54.262567 26591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:54.263316 26591 raft_consensus.cc:504] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be79c9d89f5141089fa12bc7df770efa" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37657 } }
I20260808 09:57:54.263461 26591 leader_election.cc:302] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be79c9d89f5141089fa12bc7df770efa; no voters:
I20260808 09:57:54.263630 26591 leader_election.cc:288] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:57:54.263702 26602 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:57:54.263887 26591 sys_catalog.cc:564] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:57:54.263885 26602 raft_consensus.cc:686] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [term 1 LEADER]: Becoming Leader. State: Replica: be79c9d89f5141089fa12bc7df770efa, State: Running, Role: LEADER
I20260808 09:57:54.264107 26602 consensus_queue.cc:237] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be79c9d89f5141089fa12bc7df770efa" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37657 } }
I20260808 09:57:54.264551 26608 sys_catalog.cc:455] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [sys.catalog]: SysCatalogTable state changed. Reason: New leader be79c9d89f5141089fa12bc7df770efa. Latest consensus state: current_term: 1 leader_uuid: "be79c9d89f5141089fa12bc7df770efa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be79c9d89f5141089fa12bc7df770efa" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37657 } } }
I20260808 09:57:54.264640 26608 sys_catalog.cc:458] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [sys.catalog]: This master's current role is: LEADER
I20260808 09:57:54.264878 26607 sys_catalog.cc:455] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be79c9d89f5141089fa12bc7df770efa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be79c9d89f5141089fa12bc7df770efa" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37657 } } }
I20260808 09:57:54.265020 26607 sys_catalog.cc:458] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa [sys.catalog]: This master's current role is: LEADER
I20260808 09:57:54.265192 26616 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:57:54.265741 26616 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 09:57:54 dist-test-slave-gw5c krb5kdc[26465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:54.267364 26616 catalog_manager.cc:1347] Generated new cluster ID: 424008bdcec041f1ab01579fe6a0b018
I20260808 09:57:54.267477 26616 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:57:54.271571 26599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.259766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34964 (local address 127.24.71.254:37657)
0808 09:57:54.259946 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:54.259958 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:54.259992 (+ 34us) server_negotiation.cc:407] Connection header received
0808 09:57:54.260591 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:54.260598 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:54.260645 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:54.260762 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:54.261607 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.262744 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.263846 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.264530 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.264626 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.267769 (+ 3143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:54.267774 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:54.267774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:54.267787 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:54.269801 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.270208 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.270211 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.270212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.270323 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.270543 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.270544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.270544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.270857 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:54.271027 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:54.271111 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 09:57:54.271270 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":98,"threads_started":1}
I20260808 09:57:54.290661 26616 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:57:54.291280 26616 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:57:54.302018 26616 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa: Generated new TSK 0
I20260808 09:57:54.302249 26616 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 09:57:54.342206 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:37657
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:54.454664 26637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:54.454881 26637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:54.454906 26637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:54.456034 26637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:54.456072 26637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:54.456094 26637 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 09:57:54.456111 26637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:57:54.457496 26637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.71.254:37657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:54.457695 26637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:54.457876 26637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:54.462936 26644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:54.462936 26645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:54.463021 26650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:54.463441 26637 server_base.cc:1034] running on GCE node
I20260808 09:57:54.463708 26637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:54.464006 26637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:54.465175 26637 hybrid_clock.cc:648] HybridClock initialized: now 1786183074465160 us; error 51 us; skew 500 ppm
Aug 08 09:57:54 dist-test-slave-gw5c krb5kdc[26465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183074, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:54.467921 26637 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 09:57:54.468393 26637 webserver.cc:460] Webserver started at http://127.24.71.193:35421/ using document root <none> and password file <none>
I20260808 09:57:54.468660 26637 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:54.468734 26637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:54.468885 26637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:54.469949 26637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "623e8c4e79c3453d88206001b34dea73"
format_stamp: "Formatted at 2026-08-08 09:57:54 on dist-test-slave-gw5c"
server_key: "00fc7b112b0188eef8d27f374a2dc13a"
server_key_iv: "bf135fea28f645034957ba61911a9e03"
server_key_version: "encryptionkey@0"
I20260808 09:57:54.470335 26637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "623e8c4e79c3453d88206001b34dea73"
format_stamp: "Formatted at 2026-08-08 09:57:54 on dist-test-slave-gw5c"
server_key: "00fc7b112b0188eef8d27f374a2dc13a"
server_key_iv: "bf135fea28f645034957ba61911a9e03"
server_key_version: "encryptionkey@0"
I20260808 09:57:54.471730 26637 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:57:54.472519 26658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:54.472697 26637 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:57:54.472805 26637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "623e8c4e79c3453d88206001b34dea73"
format_stamp: "Formatted at 2026-08-08 09:57:54 on dist-test-slave-gw5c"
server_key: "00fc7b112b0188eef8d27f374a2dc13a"
server_key_iv: "bf135fea28f645034957ba61911a9e03"
server_key_version: "encryptionkey@0"
I20260808 09:57:54.472882 26637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:54.490437 26637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:54.492529 26637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:54.492713 26637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:54.493302 26637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:57:54.493394 26637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:54.493469 26637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:57:54.493503 26637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 09:57:54 dist-test-slave-gw5c krb5kdc[26465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183074, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:54.501062 26637 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:41225
I20260808 09:57:54.501142 26832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:41225 every 8 connection(s)
I20260808 09:57:54.501518 26637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 09:57:54.504024 26599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.493947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:60213 (local address 127.24.71.254:37657)
0808 09:57:54.493997 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:54.493999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:54.494246 (+ 247us) server_negotiation.cc:407] Connection header received
0808 09:57:54.494807 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:54.494809 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:54.494823 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:54.494890 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:54.495817 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.496357 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.497382 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.497614 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.497709 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.501010 (+ 3301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:54.501011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:54.501012 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:54.501019 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:54.502659 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.503052 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.503053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.503053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.503110 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.503338 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.503339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.503339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.503514 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:54.503571 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:54.503874 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 09:57:54.503957 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 09:57:54.504087 26670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.493935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37657 (local address 127.24.71.193:60213)
0808 09:57:54.494125 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:54.494163 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:54.494686 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:54.494971 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:54.494980 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:54.495417 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:54.495721 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.495726 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.496468 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.496469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.497289 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.497291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.497736 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.497737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.497882 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.498483 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:54.498501 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:54.500899 (+ 2398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:54.502758 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:54.502764 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:54.502766 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:54.502983 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:54.503169 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:54.503170 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:54.503170 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:54.503279 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:54.503573 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:54.503579 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:54.503698 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 09:57:54.503800 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 09:57:54.503929 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":107,"threads_started":1}
I20260808 09:57:54.504619 26833 heartbeater.cc:347] Connected to a master server at 127.24.71.254:37657
I20260808 09:57:54.504733 26833 heartbeater.cc:464] Registering TS with master...
I20260808 09:57:54.504940 26833 heartbeater.cc:511] Master 127.24.71.254:37657 requested a full tablet report, sending...
I20260808 09:57:54.505548 26528 ts_manager.cc:194] Registered new tserver with Master: 623e8c4e79c3453d88206001b34dea73 (127.24.71.193:41225)
I20260808 09:57:54.506518 26528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:60213
I20260808 09:57:54.509024 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 26637
I20260808 09:57:54.509186 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:57:54.509358 24863 external_mini_cluster.cc:1428] Setting key 2ad6513b012ba2c4d2f8551d6007eb10
I20260808 09:57:54.511919 26599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.505896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:41365 (local address 127.24.71.254:37657)
0808 09:57:54.505938 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:54.505940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:54.506021 (+ 81us) server_negotiation.cc:407] Connection header received
0808 09:57:54.506080 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:54.506081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:54.506088 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:54.506129 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:54.506497 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.507089 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.507902 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.508085 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.508153 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.509217 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:54.509219 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:54.509219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:54.509226 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:54.510698 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.511072 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.511074 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.511074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.511138 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.511352 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.511353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.511353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.511498 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:54.511576 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:54.511740 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 09:57:54.511821 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 09:57:54.511927 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.505798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37657 (local address 127.24.71.193:41365)
0808 09:57:54.505956 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:54.505967 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:54.506028 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:54.506141 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:54.506142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:54.506351 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:54.506419 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.506421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.507175 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.507176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.507810 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.507812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.508177 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.508178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.508245 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.508761 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:54.508766 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:54.509101 (+ 335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:54.510804 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:54.510805 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:54.510806 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:54.510989 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:54.511206 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:54.511207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:54.511208 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:54.511284 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:54.511567 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:54.511568 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:54.511620 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 09:57:54.511711 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 09:57:54.511824 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 09:57:54.538061 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:37657
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:54.621287 26849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:54.621512 26849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:54.621537 26849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:54.622732 26849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:54.622778 26849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:54.622798 26849 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 09:57:54.622816 26849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:57:54.624344 26849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.71.254:37657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:54.624616 26849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:54.624856 26849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:54.629976 26863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:54.629976 26860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:54.630273 26849 server_base.cc:1034] running on GCE node
W20260808 09:57:54.630005 26858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:54.630560 26849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:54.630772 26849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:54.631920 26849 hybrid_clock.cc:648] HybridClock initialized: now 1786183074631909 us; error 30 us; skew 500 ppm
Aug 08 09:57:54 dist-test-slave-gw5c krb5kdc[26465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183074, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:54.634408 26849 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 09:57:54.634860 26849 webserver.cc:460] Webserver started at http://127.24.71.194:34005/ using document root <none> and password file <none>
I20260808 09:57:54.635092 26849 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:54.635161 26849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:54.635315 26849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:54.636425 26849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "696ff01aee864aeda637787819824472"
format_stamp: "Formatted at 2026-08-08 09:57:54 on dist-test-slave-gw5c"
server_key: "90ad84cef2011966a61c67f5005813ee"
server_key_iv: "745424ece5fe202d32dbe8bcba6f816d"
server_key_version: "encryptionkey@0"
I20260808 09:57:54.636809 26849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "696ff01aee864aeda637787819824472"
format_stamp: "Formatted at 2026-08-08 09:57:54 on dist-test-slave-gw5c"
server_key: "90ad84cef2011966a61c67f5005813ee"
server_key_iv: "745424ece5fe202d32dbe8bcba6f816d"
server_key_version: "encryptionkey@0"
I20260808 09:57:54.638140 26849 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 09:57:54.638911 26872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:54.639101 26849 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:57:54.639216 26849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "696ff01aee864aeda637787819824472"
format_stamp: "Formatted at 2026-08-08 09:57:54 on dist-test-slave-gw5c"
server_key: "90ad84cef2011966a61c67f5005813ee"
server_key_iv: "745424ece5fe202d32dbe8bcba6f816d"
server_key_version: "encryptionkey@0"
I20260808 09:57:54.639312 26849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:54.661682 26849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:54.664017 26849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:54.664167 26849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:54.664824 26849 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:57:54.664867 26849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:54.664892 26849 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:57:54.664906 26849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 09:57:54 dist-test-slave-gw5c krb5kdc[26465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183074, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:54.672616 26849 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:39375
I20260808 09:57:54.672680 27075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:39375 every 8 connection(s)
I20260808 09:57:54.673041 26849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:57:54.673863 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 26849
I20260808 09:57:54.673941 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:57:54.674139 24863 external_mini_cluster.cc:1428] Setting key ba87aee4d82b334c8c364ddf2a7239c4
I20260808 09:57:54.675846 26599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.665335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:36111 (local address 127.24.71.254:37657)
0808 09:57:54.665410 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:54.665412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:54.665628 (+ 216us) server_negotiation.cc:407] Connection header received
0808 09:57:54.666118 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:54.666120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:54.666134 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:54.666222 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:54.667088 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.668070 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.669265 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.669630 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.669717 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.672425 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:54.672426 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:54.672427 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:54.672436 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:54.674145 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.674680 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.674681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.674681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.674743 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.675053 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.675054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.675054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.675210 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:54.675288 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:54.675618 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 09:57:54.675714 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 09:57:54.675983 26889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.665310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37657 (local address 127.24.71.194:36111)
0808 09:57:54.665493 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:54.665534 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:54.666017 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:54.666277 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:54.666281 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:54.666682 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:54.666973 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.666981 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.668179 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.668180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.669162 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.669165 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.669738 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.669739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.669897 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.670443 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:54.670452 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:54.672297 (+ 1845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:54.674249 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:54.674257 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:54.674260 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:54.674519 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:54.674812 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:54.674830 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:54.674831 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:54.674999 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:54.675290 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:54.675294 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:54.675473 (+ 179us) client_negotiation.cc:769] Sending connection context
0808 09:57:54.675574 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 09:57:54.675758 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":93,"threads_started":1}
I20260808 09:57:54.676438 27077 heartbeater.cc:347] Connected to a master server at 127.24.71.254:37657
I20260808 09:57:54.676534 27077 heartbeater.cc:464] Registering TS with master...
I20260808 09:57:54.676775 27077 heartbeater.cc:511] Master 127.24.71.254:37657 requested a full tablet report, sending...
I20260808 09:57:54.677237 26529 ts_manager.cc:194] Registered new tserver with Master: 696ff01aee864aeda637787819824472 (127.24.71.194:39375)
I20260808 09:57:54.677783 26529 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:36111
I20260808 09:57:54.683936 26599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.677596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:54457 (local address 127.24.71.254:37657)
0808 09:57:54.677635 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:54.677637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:54.677755 (+ 118us) server_negotiation.cc:407] Connection header received
0808 09:57:54.677828 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:54.677829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:54.677840 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:54.677915 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:54.678319 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.679019 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.679763 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.680102 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.680184 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.681165 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:54.681166 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:54.681166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:54.681172 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:54.682623 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.683011 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.683012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.683013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.683074 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.683278 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.683279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.683280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.683511 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:54.683589 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:54.683758 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 09:57:54.683843 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 09:57:54.683959 27091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.677552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37657 (local address 127.24.71.194:54457)
0808 09:57:54.677679 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:54.677689 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:54.677770 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:54.677920 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:54.677921 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:54.678148 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:54.678224 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.678232 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.679120 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.679121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.679682 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.679684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.680191 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.680193 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.680276 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.680793 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:54.680797 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:54.681073 (+ 276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:54.682734 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:54.682735 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:54.682736 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:54.682922 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:54.683143 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:54.683144 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:54.683144 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:54.683211 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:54.683593 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:54.683595 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:54.683644 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 09:57:54.683729 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 09:57:54.683839 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":65,"threads_started":1}
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 09:57:54.702236 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:37657
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:54.786870 27093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:54.787077 27093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:54.787101 27093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:54.788281 27093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:54.788327 27093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:54.788348 27093 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 09:57:54.788408 27093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:57:54.789834 27093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.71.254:37657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:54.790086 27093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:54.790333 27093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:54.795332 27100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:54.795341 27106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:54.795604 27093 server_base.cc:1034] running on GCE node
W20260808 09:57:54.795370 27103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:54.795859 27093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:54.796079 27093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:54.797246 27093 hybrid_clock.cc:648] HybridClock initialized: now 1786183074797242 us; error 35 us; skew 500 ppm
Aug 08 09:57:54 dist-test-slave-gw5c krb5kdc[26465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183074, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:54.799719 27093 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 09:57:54.800225 27093 webserver.cc:460] Webserver started at http://127.24.71.195:39187/ using document root <none> and password file <none>
I20260808 09:57:54.800460 27093 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:54.800529 27093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:54.800681 27093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:54.801767 27093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "891e1a450fd4479f9fd1db8936354f4e"
format_stamp: "Formatted at 2026-08-08 09:57:54 on dist-test-slave-gw5c"
server_key: "b8331c5eb905c362b6bb648c3265fa91"
server_key_iv: "8b15020b660668712ea942f3cb07f914"
server_key_version: "encryptionkey@0"
I20260808 09:57:54.802234 27093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "891e1a450fd4479f9fd1db8936354f4e"
format_stamp: "Formatted at 2026-08-08 09:57:54 on dist-test-slave-gw5c"
server_key: "b8331c5eb905c362b6bb648c3265fa91"
server_key_iv: "8b15020b660668712ea942f3cb07f914"
server_key_version: "encryptionkey@0"
I20260808 09:57:54.803630 27093 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260808 09:57:54.804425 27114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:54.804600 27093 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:57:54.804700 27093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "891e1a450fd4479f9fd1db8936354f4e"
format_stamp: "Formatted at 2026-08-08 09:57:54 on dist-test-slave-gw5c"
server_key: "b8331c5eb905c362b6bb648c3265fa91"
server_key_iv: "8b15020b660668712ea942f3cb07f914"
server_key_version: "encryptionkey@0"
I20260808 09:57:54.804798 27093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:54.822232 27093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:54.824281 27093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:54.824452 27093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:54.825042 27093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:57:54.825103 27093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:54.825186 27093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:57:54.825222 27093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 09:57:54 dist-test-slave-gw5c krb5kdc[26465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183074, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:54.832736 27093 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:41989
I20260808 09:57:54.832834 27285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:41989 every 8 connection(s)
I20260808 09:57:54.833256 27093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:57:54.835323 26599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.825467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:58799 (local address 127.24.71.254:37657)
0808 09:57:54.825519 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:54.825522 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:54.825772 (+ 250us) server_negotiation.cc:407] Connection header received
0808 09:57:54.826263 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:54.826265 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:54.826280 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:54.826359 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:54.827078 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.827755 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.828726 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.828942 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.829038 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.832361 (+ 3323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:54.832362 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:54.832363 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:54.832369 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:54.834064 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.834417 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.834418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.834419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.834483 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.834760 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.834760 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.834760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.834864 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:54.834915 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:54.835174 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 09:57:54.835255 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 09:57:54.835546 27130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.825463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37657 (local address 127.24.71.195:58799)
0808 09:57:54.825647 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:54.825689 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:54.826165 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:54.826458 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:54.826477 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:54.826754 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:54.826980 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.826985 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.827837 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.827838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.828628 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.828629 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.829049 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.829050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.829216 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.829723 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:54.829734 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:54.832258 (+ 2524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:54.834138 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:54.834142 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:54.834143 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:54.834349 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:54.834567 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:54.834568 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:54.834569 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:54.834684 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:54.834925 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:54.834930 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:54.835042 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 09:57:54.835134 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 09:57:54.835272 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":114,"threads_started":1}
I20260808 09:57:54.836105 27286 heartbeater.cc:347] Connected to a master server at 127.24.71.254:37657
I20260808 09:57:54.836193 27286 heartbeater.cc:464] Registering TS with master...
I20260808 09:57:54.836378 27286 heartbeater.cc:511] Master 127.24.71.254:37657 requested a full tablet report, sending...
I20260808 09:57:54.836779 26528 ts_manager.cc:194] Registered new tserver with Master: 891e1a450fd4479f9fd1db8936354f4e (127.24.71.195:41989)
I20260808 09:57:54.837296 26528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:58799
I20260808 09:57:54.838001 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 27093
I20260808 09:57:54.838114 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:57:54.838306 24863 external_mini_cluster.cc:1428] Setting key 92193674932fe9489c914ea6184fd0bb
I20260808 09:57:54.839124 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 09:57:54.843660 27293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.837202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37657 (local address 127.24.71.195:35057)
0808 09:57:54.837347 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:54.837358 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:54.837413 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:54.837611 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:54.837612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:54.837836 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:54.837903 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.837905 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.838784 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.838785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.839546 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.839549 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.839903 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.839904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.839984 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.840475 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:54.840480 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:54.840763 (+ 283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:54.842600 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:54.842600 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:54.842601 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:54.842773 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:54.842997 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:54.842997 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:54.842997 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:54.843053 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:54.843320 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:54.843321 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:54.843356 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 09:57:54.843486 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 09:57:54.843590 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
I20260808 09:57:54.843739 26599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.837314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:35057 (local address 127.24.71.254:37657)
0808 09:57:54.837355 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:54.837358 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:54.837398 (+ 40us) server_negotiation.cc:407] Connection header received
0808 09:57:54.837512 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:54.837513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:54.837527 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:54.837609 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:54.838004 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.838682 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.839626 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.839830 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.839905 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.840870 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:54.840871 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:54.840872 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:54.840879 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:54.842522 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.842861 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.842862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.842862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.842927 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.843117 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.843118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.843118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.843259 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:54.843328 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:54.843517 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 09:57:54.843603 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
Aug 08 09:57:54 dist-test-slave-gw5c krb5kdc[26465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183074, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 09:57:54 dist-test-slave-gw5c krb5kdc[26465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183074, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:54.868206 26599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.857410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34976 (local address 127.24.71.254:37657)
0808 09:57:54.857462 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:54.857464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:54.857498 (+ 34us) server_negotiation.cc:407] Connection header received
0808 09:57:54.857564 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:54.857565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:54.857574 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:54.857624 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:54.858421 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.860029 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.861325 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.861678 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.861727 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.864886 (+ 3159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:54.864889 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:54.864889 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:54.864898 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:54.866882 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.867268 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.867270 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.867270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.867344 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:54.867601 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:54.867602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:54.867602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:54.867765 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:54.867871 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:54.867971 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 09:57:54.868067 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 09:57:54.870118 26528 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34976:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:57:54.871913 26528 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:57:54.879383 27312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.874522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:41225 (local address 127.0.0.1:46528)
0808 09:57:54.875202 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:54.875212 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:54.875267 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:54.875692 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:54.875693 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:54.875695 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:54.875745 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.875747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.877381 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.877382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.878196 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.878198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.879086 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.879087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.879170 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.879184 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 09:57:54.879252 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 09:57:54.879305 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":66,"threads_started":1}
I20260808 09:57:54.880033 27314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.874300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:39375 (local address 127.0.0.1:48438)
0808 09:57:54.874789 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:54.874834 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:54.874924 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:54.875246 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:54.875250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:54.875253 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:54.875379 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.875383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.877065 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.877066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.878607 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.878610 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.879752 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.879753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.879836 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.879841 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 09:57:54.879890 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 09:57:54.879940 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":52,"threads_started":1}
I20260808 09:57:54.880299 27313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.874394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48438 (local address 127.24.71.194:39375)
0808 09:57:54.874614 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:54.874620 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:54.874940 (+ 320us) server_negotiation.cc:407] Connection header received
0808 09:57:54.875031 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:54.875035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:54.875056 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:54.875152 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:54.875489 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.876960 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.878709 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.879598 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.879664 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.879717 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:54.880145 (+ 428us) server_negotiation.cc:299] Negotiation successful
0808 09:57:54.880197 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":103,"threads_started":1}
I20260808 09:57:54.880664 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.874794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46528 (local address 127.24.71.193:41225)
0808 09:57:54.875004 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:54.875009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:54.875326 (+ 317us) server_negotiation.cc:407] Connection header received
0808 09:57:54.875375 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:54.875377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:54.875539 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:54.875617 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:54.875828 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.876999 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.878291 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.878897 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.878987 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.879050 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:54.880508 (+ 1458us) server_negotiation.cc:299] Negotiation successful
0808 09:57:54.880558 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":88,"threads_started":1}
I20260808 09:57:54.881026 26963 tablet_service.cc:1467] Processing CreateTablet for tablet ee33524a7da64a7991baef820dcdd0d2 (DEFAULT_TABLE table=test-table [id=c81450cbea584e9d82105fcba683b5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:54.881239 27317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.874543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57818 (local address 127.24.71.195:41989)
0808 09:57:54.874715 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:54.874719 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:54.875127 (+ 408us) server_negotiation.cc:407] Connection header received
0808 09:57:54.875563 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:54.875567 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:54.875584 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:54.875656 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:54.875836 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.877054 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.880076 (+ 3022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.880861 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.880932 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.880994 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:54.881096 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 09:57:54.881137 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":82,"threads_started":1}
I20260808 09:57:54.881188 27311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:54.874324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:41989 (local address 127.0.0.1:57818)
0808 09:57:54.875042 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:54.875050 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:54.875450 (+ 400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:54.875722 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:54.875722 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:54.875725 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:54.875759 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.875760 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.877143 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.877144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.879968 (+ 2824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:54.879971 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:54.880953 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:54.880954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:54.881026 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:54.881030 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:57:54.881086 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 09:57:54.881123 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"mutex_wait_us":1455,"thread_start_us":108,"threads_started":1}
I20260808 09:57:54.881440 26963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee33524a7da64a7991baef820dcdd0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:54.881313 26737 tablet_service.cc:1467] Processing CreateTablet for tablet ee33524a7da64a7991baef820dcdd0d2 (DEFAULT_TABLE table=test-table [id=c81450cbea584e9d82105fcba683b5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:54.881678 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee33524a7da64a7991baef820dcdd0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:54.884701 27319 tablet_bootstrap.cc:492] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73: Bootstrap starting.
I20260808 09:57:54.885341 27320 tablet_bootstrap.cc:492] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472: Bootstrap starting.
I20260808 09:57:54.885422 27319 tablet_bootstrap.cc:654] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:54.885557 27191 tablet_service.cc:1467] Processing CreateTablet for tablet ee33524a7da64a7991baef820dcdd0d2 (DEFAULT_TABLE table=test-table [id=c81450cbea584e9d82105fcba683b5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:54.885782 27319 log.cc:824] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73: Log is configured to *not* fsync() on all Append() calls
I20260808 09:57:54.885929 27191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee33524a7da64a7991baef820dcdd0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:54.886030 27320 tablet_bootstrap.cc:654] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:54.886387 27320 log.cc:824] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472: Log is configured to *not* fsync() on all Append() calls
I20260808 09:57:54.886930 27319 tablet_bootstrap.cc:492] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73: No bootstrap required, opened a new log
I20260808 09:57:54.887017 27319 ts_tablet_manager.cc:1397] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:57:54.887199 27320 tablet_bootstrap.cc:492] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472: No bootstrap required, opened a new log
I20260808 09:57:54.887271 27320 ts_tablet_manager.cc:1397] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 09:57:54.889146 27319 raft_consensus.cc:348] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } }
I20260808 09:57:54.889334 27319 raft_consensus.cc:374] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:54.889384 27319 raft_consensus.cc:729] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 623e8c4e79c3453d88206001b34dea73, State: Initialized, Role: FOLLOWER
I20260808 09:57:54.889506 27319 consensus_queue.cc:260] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } }
I20260808 09:57:54.889822 27319 ts_tablet_manager.cc:1428] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 09:57:54.889946 26833 heartbeater.cc:503] Master 127.24.71.254:37657 was elected leader, sending a full tablet report...
I20260808 09:57:54.889863 27320 raft_consensus.cc:348] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } }
I20260808 09:57:54.890026 27320 raft_consensus.cc:374] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:54.890064 27320 raft_consensus.cc:729] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 696ff01aee864aeda637787819824472, State: Initialized, Role: FOLLOWER
I20260808 09:57:54.890205 27320 consensus_queue.cc:260] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } }
I20260808 09:57:54.890496 27320 ts_tablet_manager.cc:1428] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 09:57:54.890611 27077 heartbeater.cc:503] Master 127.24.71.254:37657 was elected leader, sending a full tablet report...
I20260808 09:57:54.890604 27325 tablet_bootstrap.cc:492] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e: Bootstrap starting.
I20260808 09:57:54.891539 27325 tablet_bootstrap.cc:654] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:54.891884 27325 log.cc:824] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e: Log is configured to *not* fsync() on all Append() calls
I20260808 09:57:54.892664 27325 tablet_bootstrap.cc:492] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e: No bootstrap required, opened a new log
I20260808 09:57:54.892721 27325 ts_tablet_manager.cc:1397] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 09:57:54.894125 27325 raft_consensus.cc:348] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } }
I20260808 09:57:54.894250 27325 raft_consensus.cc:374] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:54.894272 27325 raft_consensus.cc:729] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 891e1a450fd4479f9fd1db8936354f4e, State: Initialized, Role: FOLLOWER
I20260808 09:57:54.894398 27325 consensus_queue.cc:260] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } }
I20260808 09:57:54.894670 27325 ts_tablet_manager.cc:1428] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 09:57:54.894799 27286 heartbeater.cc:503] Master 127.24.71.254:37657 was elected leader, sending a full tablet report...
W20260808 09:57:54.923750 27078 tablet.cc:2369] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 09:57:55.002480 26834 tablet.cc:2369] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 09:57:55.083964 27288 tablet.cc:2369] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 09:57:55.099035 27328 raft_consensus.cc:482] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:57:55.099169 27328 raft_consensus.cc:504] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } }
I20260808 09:57:55.099562 27328 leader_election.cc:288] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 891e1a450fd4479f9fd1db8936354f4e (127.24.71.195:41989), 623e8c4e79c3453d88206001b34dea73 (127.24.71.193:41225)
I20260808 09:57:55.102560 27317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.099928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:45839 (local address 127.24.71.195:41989)
0808 09:57:55.099990 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:55.099992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:55.100002 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:57:55.100031 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:55.100031 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:55.100040 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:55.100106 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:55.100280 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.100825 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.101791 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.102171 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.102262 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.102274 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:55.102442 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 09:57:55.102484 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 09:57:55.102566 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.100056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:50069 (local address 127.24.71.193:41225)
0808 09:57:55.100099 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:55.100101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:55.100210 (+ 109us) server_negotiation.cc:407] Connection header received
0808 09:57:55.100244 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:55.100246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:55.100256 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:55.100314 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:55.100436 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.100886 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.101819 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.102188 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.102278 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.102287 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:55.102442 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 09:57:55.102495 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 09:57:55.102571 26889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.099805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:41989 (local address 127.24.71.194:45839)
0808 09:57:55.099856 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:55.099868 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:55.099915 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:55.100124 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:55.100125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:55.100127 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:55.100203 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.100205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.100919 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.100920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.101685 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.101687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.102261 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.102262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.102352 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.102356 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:57:55.102424 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 09:57:55.102484 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 09:57:55.102665 27336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.099915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:41225 (local address 127.24.71.194:50069)
0808 09:57:55.100126 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:55.100136 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:55.100197 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:55.100314 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:55.100315 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:55.100316 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:55.100374 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.100375 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.101000 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.101001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.101722 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.101724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.102279 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.102281 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.102365 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.102368 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:57:55.102437 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 09:57:55.102519 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":38,"thread_start_us":137,"threads_started":1}
I20260808 09:57:55.102952 27220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee33524a7da64a7991baef820dcdd0d2" candidate_uuid: "696ff01aee864aeda637787819824472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "891e1a450fd4479f9fd1db8936354f4e" is_pre_election: true
I20260808 09:57:55.103030 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee33524a7da64a7991baef820dcdd0d2" candidate_uuid: "696ff01aee864aeda637787819824472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "623e8c4e79c3453d88206001b34dea73" is_pre_election: true
I20260808 09:57:55.103121 27220 raft_consensus.cc:2454] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 696ff01aee864aeda637787819824472 in term 0.
I20260808 09:57:55.103209 26767 raft_consensus.cc:2454] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 696ff01aee864aeda637787819824472 in term 0.
I20260808 09:57:55.103438 26879 leader_election.cc:302] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 696ff01aee864aeda637787819824472, 891e1a450fd4479f9fd1db8936354f4e; no voters:
I20260808 09:57:55.103578 27328 raft_consensus.cc:2781] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:57:55.103641 27328 raft_consensus.cc:482] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:57:55.103665 27328 raft_consensus.cc:3037] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:55.104882 27328 raft_consensus.cc:504] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } }
I20260808 09:57:55.105026 27328 leader_election.cc:288] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [CANDIDATE]: Term 1 election: Requested vote from peers 891e1a450fd4479f9fd1db8936354f4e (127.24.71.195:41989), 623e8c4e79c3453d88206001b34dea73 (127.24.71.193:41225)
I20260808 09:57:55.105226 27220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee33524a7da64a7991baef820dcdd0d2" candidate_uuid: "696ff01aee864aeda637787819824472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "891e1a450fd4479f9fd1db8936354f4e"
I20260808 09:57:55.105239 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee33524a7da64a7991baef820dcdd0d2" candidate_uuid: "696ff01aee864aeda637787819824472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "623e8c4e79c3453d88206001b34dea73"
I20260808 09:57:55.105324 26767 raft_consensus.cc:3037] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:55.105330 27220 raft_consensus.cc:3037] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:55.106065 26767 raft_consensus.cc:2454] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 696ff01aee864aeda637787819824472 in term 1.
I20260808 09:57:55.106240 27220 raft_consensus.cc:2454] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 696ff01aee864aeda637787819824472 in term 1.
I20260808 09:57:55.106271 26879 leader_election.cc:302] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 623e8c4e79c3453d88206001b34dea73, 696ff01aee864aeda637787819824472; no voters:
I20260808 09:57:55.106364 27328 raft_consensus.cc:2781] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:57:55.106526 27328 raft_consensus.cc:686] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [term 1 LEADER]: Becoming Leader. State: Replica: 696ff01aee864aeda637787819824472, State: Running, Role: LEADER
I20260808 09:57:55.106637 27328 consensus_queue.cc:237] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } }
I20260808 09:57:55.107563 26529 catalog_manager.cc:5495] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 696ff01aee864aeda637787819824472 (127.24.71.194). New cstate: current_term: 1 leader_uuid: "696ff01aee864aeda637787819824472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } health_report { overall_health: UNKNOWN } } }
I20260808 09:57:55.162365 27313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.159450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48450 (local address 127.24.71.194:39375)
0808 09:57:55.159523 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:55.159525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:55.159536 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:57:55.159625 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:55.159626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:55.159655 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:55.159737 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:57:55.159929 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.160453 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.161363 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.161582 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.161679 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.161932 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:57:55.162051 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:57:55.162155 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:55.162213 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 09:57:55.162238 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 09:57:55.164474 26767 raft_consensus.cc:1261] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73 [term 1 FOLLOWER]: Refusing update from remote peer 696ff01aee864aeda637787819824472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:57:55.164499 27220 raft_consensus.cc:1261] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e [term 1 FOLLOWER]: Refusing update from remote peer 696ff01aee864aeda637787819824472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:57:55.164894 27328 consensus_queue.cc:1035] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:57:55.165110 27337 consensus_queue.cc:1035] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:57:55.167459 27344 mvcc.cc:205] Tried to move back new op lower bound from 7316205875870208000 to 7316205875637354496. Current Snapshot: MvccSnapshot[applied={T|T < 7316205875870208000}]
I20260808 09:57:55.167706 27348 mvcc.cc:205] Tried to move back new op lower bound from 7316205875870208000 to 7316205875637354496. Current Snapshot: MvccSnapshot[applied={T|T < 7316205875870208000}]
I20260808 09:57:55.168587 27347 mvcc.cc:205] Tried to move back new op lower bound from 7316205875870208000 to 7316205875637354496. Current Snapshot: MvccSnapshot[applied={T|T < 7316205875870208000}]
I20260808 09:57:55.171527 26528 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:57:55.171671 26528 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:57:55.172715 26528 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa: Sending DeleteTablet for 3 replicas of tablet ee33524a7da64a7991baef820dcdd0d2
I20260808 09:57:55.173172 26963 tablet_service.cc:1514] Processing DeleteTablet for tablet ee33524a7da64a7991baef820dcdd0d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:57:55 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:48438
I20260808 09:57:55.173202 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet ee33524a7da64a7991baef820dcdd0d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:57:55 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:46528
I20260808 09:57:55.173358 26528 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34976:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:57:55.173478 26528 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:57:55.174813 27191 tablet_service.cc:1514] Processing DeleteTablet for tablet ee33524a7da64a7991baef820dcdd0d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:57:55 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:57818
I20260808 09:57:55.175381 27357 tablet_replica.cc:330] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472: stopping tablet replica
I20260808 09:57:55.175570 27357 raft_consensus.cc:2229] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [term 1 LEADER]: Raft consensus shutting down.
I20260808 09:57:55.175701 27357 raft_consensus.cc:2258] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:57:55.176222 27358 tablet_replica.cc:330] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e: stopping tablet replica
I20260808 09:57:55.176394 26963 tablet_service.cc:1467] Processing CreateTablet for tablet 3a718b26655c444c874c4eb2d49e57c3 (DEFAULT_TABLE table=test-table [id=9f0133ad6a9840d3aff7358abb826607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:55.176391 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 3a718b26655c444c874c4eb2d49e57c3 (DEFAULT_TABLE table=test-table [id=9f0133ad6a9840d3aff7358abb826607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:55.176416 27357 ts_tablet_manager.cc:1905] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:57:55.176451 27358 raft_consensus.cc:2229] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:57:55.176527 26963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a718b26655c444c874c4eb2d49e57c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:55.176538 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a718b26655c444c874c4eb2d49e57c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:55.176579 27358 raft_consensus.cc:2258] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:57:55.178023 27319 tablet_bootstrap.cc:492] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73: Bootstrap starting.
I20260808 09:57:55.178104 27320 tablet_bootstrap.cc:492] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472: Bootstrap starting.
I20260808 09:57:55.178117 27357 ts_tablet_manager.cc:1918] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:57:55.178198 27357 log.cc:1196] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/ee33524a7da64a7991baef820dcdd0d2
I20260808 09:57:55.178540 27320 tablet_bootstrap.cc:654] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:55.178565 27357 ts_tablet_manager.cc:1939] T ee33524a7da64a7991baef820dcdd0d2 P 696ff01aee864aeda637787819824472: Deleting consensus metadata
I20260808 09:57:55.178565 27319 tablet_bootstrap.cc:654] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:55.179040 26505 catalog_manager.cc:4841] TS 696ff01aee864aeda637787819824472 (127.24.71.194:39375): tablet ee33524a7da64a7991baef820dcdd0d2 (table test-table [id=c81450cbea584e9d82105fcba683b5ce]) successfully deleted
I20260808 09:57:55.179230 27191 tablet_service.cc:1467] Processing CreateTablet for tablet 3a718b26655c444c874c4eb2d49e57c3 (DEFAULT_TABLE table=test-table [id=9f0133ad6a9840d3aff7358abb826607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:55.179356 27191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a718b26655c444c874c4eb2d49e57c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:55.179613 27320 tablet_bootstrap.cc:492] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472: No bootstrap required, opened a new log
I20260808 09:57:55.179663 27320 ts_tablet_manager.cc:1397] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:57:55.179792 27320 raft_consensus.cc:348] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.179858 27320 raft_consensus.cc:374] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:55.179843 27319 tablet_bootstrap.cc:492] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73: No bootstrap required, opened a new log
I20260808 09:57:55.179879 27320 raft_consensus.cc:729] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 696ff01aee864aeda637787819824472, State: Initialized, Role: FOLLOWER
I20260808 09:57:55.179896 27319 ts_tablet_manager.cc:1397] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:57:55.179930 27320 consensus_queue.cc:260] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.180020 27320 ts_tablet_manager.cc:1428] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:55.180069 27319 raft_consensus.cc:348] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.180158 27319 raft_consensus.cc:374] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:55.180182 27319 raft_consensus.cc:729] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 623e8c4e79c3453d88206001b34dea73, State: Initialized, Role: FOLLOWER
I20260808 09:57:55.180243 27319 consensus_queue.cc:260] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.180373 27319 ts_tablet_manager.cc:1428] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 09:57:55.180711 27358 ts_tablet_manager.cc:1905] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:57:55.180824 27325 tablet_bootstrap.cc:492] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e: Bootstrap starting.
I20260808 09:57:55.184037 27325 tablet_bootstrap.cc:654] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:55.184682 27325 tablet_bootstrap.cc:492] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e: No bootstrap required, opened a new log
I20260808 09:57:55.184732 27325 ts_tablet_manager.cc:1397] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260808 09:57:55.184899 27325 raft_consensus.cc:348] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.184978 27325 raft_consensus.cc:374] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:55.185002 27325 raft_consensus.cc:729] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 891e1a450fd4479f9fd1db8936354f4e, State: Initialized, Role: FOLLOWER
I20260808 09:57:55.185012 27358 ts_tablet_manager.cc:1918] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:57:55.185053 27325 consensus_queue.cc:260] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.185086 27358 log.cc:1196] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/ee33524a7da64a7991baef820dcdd0d2
I20260808 09:57:55.185135 27325 ts_tablet_manager.cc:1428] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:55.185384 27358 ts_tablet_manager.cc:1939] T ee33524a7da64a7991baef820dcdd0d2 P 891e1a450fd4479f9fd1db8936354f4e: Deleting consensus metadata
I20260808 09:57:55.185820 26506 catalog_manager.cc:4841] TS 891e1a450fd4479f9fd1db8936354f4e (127.24.71.195:41989): tablet ee33524a7da64a7991baef820dcdd0d2 (table test-table [id=c81450cbea584e9d82105fcba683b5ce]) successfully deleted
I20260808 09:57:55.185958 27356 tablet_replica.cc:330] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73: stopping tablet replica
I20260808 09:57:55.186097 27356 raft_consensus.cc:2229] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:57:55.186221 27356 raft_consensus.cc:2258] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:57:55.186640 27356 ts_tablet_manager.cc:1905] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:57:55.188464 27356 ts_tablet_manager.cc:1918] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:57:55.188613 27356 log.cc:1196] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/wal/wals/ee33524a7da64a7991baef820dcdd0d2
I20260808 09:57:55.188899 27356 ts_tablet_manager.cc:1939] T ee33524a7da64a7991baef820dcdd0d2 P 623e8c4e79c3453d88206001b34dea73: Deleting consensus metadata
I20260808 09:57:55.189283 26506 catalog_manager.cc:4841] TS 623e8c4e79c3453d88206001b34dea73 (127.24.71.193:41225): tablet ee33524a7da64a7991baef820dcdd0d2 (table test-table [id=c81450cbea584e9d82105fcba683b5ce]) successfully deleted
I20260808 09:57:55.356098 27326 raft_consensus.cc:482] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:57:55.356228 27326 raft_consensus.cc:504] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.356612 27326 leader_election.cc:288] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 696ff01aee864aeda637787819824472 (127.24.71.194:39375), 891e1a450fd4479f9fd1db8936354f4e (127.24.71.195:41989)
I20260808 09:57:55.360028 27317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.356941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:43519 (local address 127.24.71.195:41989)
0808 09:57:55.356999 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:55.357002 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:55.357070 (+ 68us) server_negotiation.cc:407] Connection header received
0808 09:57:55.357144 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:55.357144 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:55.357161 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:55.357229 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:55.357433 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.357909 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.359235 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.359661 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.359746 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.359756 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:55.359906 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 09:57:55.359947 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 09:57:55.360069 27313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.356879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:55497 (local address 127.24.71.194:39375)
0808 09:57:55.356930 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:55.356932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:55.357035 (+ 103us) server_negotiation.cc:407] Connection header received
0808 09:57:55.357136 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:55.357138 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:55.357151 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:55.357262 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:55.357453 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.357913 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.359241 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.359678 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.359761 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.359772 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:55.359954 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 09:57:55.360003 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 09:57:55.360097 27363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.356807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:39375 (local address 127.24.71.193:55497)
0808 09:57:55.356970 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:55.356983 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:55.357053 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:55.357233 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:55.357234 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:55.357236 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:55.357373 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.357375 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.358007 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.358009 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.359139 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.359142 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.359781 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.359782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.359865 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.359868 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:57:55.359946 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 09:57:55.359988 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":21,"thread_start_us":97,"threads_started":1}
I20260808 09:57:55.360097 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.356829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:41989 (local address 127.24.71.193:43519)
0808 09:57:55.356988 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:55.356998 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:55.357084 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:55.357236 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:55.357237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:55.357239 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:55.357350 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.357353 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.358007 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.358008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.359143 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.359146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.359744 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.359745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.359822 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.359826 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:57:55.359902 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 09:57:55.359944 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":74,"thread_start_us":68,"threads_started":1}
I20260808 09:57:55.360445 27220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a718b26655c444c874c4eb2d49e57c3" candidate_uuid: "623e8c4e79c3453d88206001b34dea73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "891e1a450fd4479f9fd1db8936354f4e" is_pre_election: true
I20260808 09:57:55.360405 26988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a718b26655c444c874c4eb2d49e57c3" candidate_uuid: "623e8c4e79c3453d88206001b34dea73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "696ff01aee864aeda637787819824472" is_pre_election: true
I20260808 09:57:55.360527 27220 raft_consensus.cc:2454] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 623e8c4e79c3453d88206001b34dea73 in term 0.
I20260808 09:57:55.360569 26988 raft_consensus.cc:2454] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 623e8c4e79c3453d88206001b34dea73 in term 0.
I20260808 09:57:55.360709 26662 leader_election.cc:302] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 623e8c4e79c3453d88206001b34dea73, 891e1a450fd4479f9fd1db8936354f4e; no voters:
I20260808 09:57:55.360849 27326 raft_consensus.cc:2781] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:57:55.360903 27326 raft_consensus.cc:482] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:57:55.360925 27326 raft_consensus.cc:3037] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:55.361604 27326 raft_consensus.cc:504] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.361752 27326 leader_election.cc:288] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [CANDIDATE]: Term 1 election: Requested vote from peers 696ff01aee864aeda637787819824472 (127.24.71.194:39375), 891e1a450fd4479f9fd1db8936354f4e (127.24.71.195:41989)
I20260808 09:57:55.361881 26988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a718b26655c444c874c4eb2d49e57c3" candidate_uuid: "623e8c4e79c3453d88206001b34dea73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "696ff01aee864aeda637787819824472"
I20260808 09:57:55.361905 27220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a718b26655c444c874c4eb2d49e57c3" candidate_uuid: "623e8c4e79c3453d88206001b34dea73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "891e1a450fd4479f9fd1db8936354f4e"
I20260808 09:57:55.361972 27220 raft_consensus.cc:3037] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:55.361974 26988 raft_consensus.cc:3037] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:55.362739 26988 raft_consensus.cc:2454] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 623e8c4e79c3453d88206001b34dea73 in term 1.
I20260808 09:57:55.362738 27220 raft_consensus.cc:2454] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 623e8c4e79c3453d88206001b34dea73 in term 1.
I20260808 09:57:55.362922 26661 leader_election.cc:302] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 623e8c4e79c3453d88206001b34dea73, 696ff01aee864aeda637787819824472; no voters:
I20260808 09:57:55.363024 27326 raft_consensus.cc:2781] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:57:55.363219 27326 raft_consensus.cc:686] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [term 1 LEADER]: Becoming Leader. State: Replica: 623e8c4e79c3453d88206001b34dea73, State: Running, Role: LEADER
I20260808 09:57:55.363298 27326 consensus_queue.cc:237] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.364100 26528 catalog_manager.cc:5495] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 623e8c4e79c3453d88206001b34dea73 (127.24.71.193). New cstate: current_term: 1 leader_uuid: "623e8c4e79c3453d88206001b34dea73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } health_report { overall_health: UNKNOWN } } }
Aug 08 09:57:55 dist-test-slave-gw5c krb5kdc[26465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183074, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:55.427006 27377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.420185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37657 (local address 127.0.0.1:34980)
0808 09:57:55.420347 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:55.420360 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:55.420444 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:55.420593 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:55.420593 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:55.420908 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:55.420970 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.420973 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.421609 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.421609 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.422150 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.422151 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.422483 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.422484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.422526 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.423038 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:55.423043 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:55.424555 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:55.426037 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:55.426045 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:55.426047 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:55.426251 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:55.426438 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:55.426439 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:55.426439 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:55.426496 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:55.426714 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:55.426720 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:55.426763 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 09:57:55.426814 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 09:57:55.426915 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":77,"threads_started":1}
I20260808 09:57:55.427075 27379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.420276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34980 (local address 127.24.71.254:37657)
0808 09:57:55.420443 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:55.420445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:55.420455 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:57:55.420497 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:55.420498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:55.420507 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:55.420569 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:55.421039 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.421538 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.422222 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.422414 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.422466 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.424640 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:55.424642 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:55.424642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:55.424648 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:55.425950 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:55.426321 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:55.426322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:55.426322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:55.426380 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:55.426550 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:55.426550 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:55.426550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:55.426659 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:55.426712 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:55.426848 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 09:57:55.426980 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":142,"thread_start_us":108,"threads_started":1}
I20260808 09:57:55.429348 26528 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:34980:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 09:57:55.429638 26528 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:57:55.431213 26963 tablet_service.cc:1467] Processing CreateTablet for tablet 3bc97efbfad943b98cb3dc53b9ec5d0f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d16756398f0f4a2086ad917607d99f19]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 09:57:55.431236 27191 tablet_service.cc:1467] Processing CreateTablet for tablet 3bc97efbfad943b98cb3dc53b9ec5d0f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d16756398f0f4a2086ad917607d99f19]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 09:57:55.431237 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 3bc97efbfad943b98cb3dc53b9ec5d0f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d16756398f0f4a2086ad917607d99f19]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 09:57:55.431468 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bc97efbfad943b98cb3dc53b9ec5d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:55.431480 26963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bc97efbfad943b98cb3dc53b9ec5d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:55.431481 27191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bc97efbfad943b98cb3dc53b9ec5d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:55.434057 27320 tablet_bootstrap.cc:492] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472: Bootstrap starting.
I20260808 09:57:55.434085 27325 tablet_bootstrap.cc:492] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e: Bootstrap starting.
I20260808 09:57:55.434087 27319 tablet_bootstrap.cc:492] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73: Bootstrap starting.
I20260808 09:57:55.434446 27320 tablet_bootstrap.cc:654] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:55.434511 27325 tablet_bootstrap.cc:654] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:55.434509 27319 tablet_bootstrap.cc:654] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:55.435250 27325 tablet_bootstrap.cc:492] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e: No bootstrap required, opened a new log
I20260808 09:57:55.435314 27325 ts_tablet_manager.cc:1397] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 09:57:55.435437 27320 tablet_bootstrap.cc:492] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472: No bootstrap required, opened a new log
I20260808 09:57:55.435511 27320 ts_tablet_manager.cc:1397] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:57:55.435536 27325 raft_consensus.cc:348] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.435622 27325 raft_consensus.cc:374] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:55.435653 27325 raft_consensus.cc:729] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 891e1a450fd4479f9fd1db8936354f4e, State: Initialized, Role: FOLLOWER
I20260808 09:57:55.435652 27320 raft_consensus.cc:348] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.435706 27325 consensus_queue.cc:260] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.435729 27320 raft_consensus.cc:374] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:55.435760 27320 raft_consensus.cc:729] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 696ff01aee864aeda637787819824472, State: Initialized, Role: FOLLOWER
I20260808 09:57:55.435807 27325 ts_tablet_manager.cc:1428] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 09:57:55.435814 27320 consensus_queue.cc:260] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.435916 27320 ts_tablet_manager.cc:1428] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:55.435954 27334 tablet_replica.cc:439] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } }
I20260808 09:57:55.436070 27334 tablet_replica.cc:442] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:55.436050 27328 tablet_replica.cc:439] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } }
I20260808 09:57:55.436133 27328 tablet_replica.cc:442] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:55.436414 27319 tablet_bootstrap.cc:492] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73: No bootstrap required, opened a new log
I20260808 09:57:55.436472 27319 ts_tablet_manager.cc:1397] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:57:55.436625 27319 raft_consensus.cc:348] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.436698 27319 raft_consensus.cc:374] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:55.436719 27319 raft_consensus.cc:729] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 623e8c4e79c3453d88206001b34dea73, State: Initialized, Role: FOLLOWER
I20260808 09:57:55.436769 27319 consensus_queue.cc:260] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.436868 27319 ts_tablet_manager.cc:1428] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:55.436914 27326 tablet_replica.cc:439] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } }
I20260808 09:57:55.436990 27326 tablet_replica.cc:442] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:55.568418 27328 raft_consensus.cc:482] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:57:55.568539 27328 raft_consensus.cc:504] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.568727 27328 leader_election.cc:288] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 623e8c4e79c3453d88206001b34dea73 (127.24.71.193:41225), 891e1a450fd4479f9fd1db8936354f4e (127.24.71.195:41989)
I20260808 09:57:55.569037 27220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc97efbfad943b98cb3dc53b9ec5d0f" candidate_uuid: "696ff01aee864aeda637787819824472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "891e1a450fd4479f9fd1db8936354f4e" is_pre_election: true
I20260808 09:57:55.569129 27220 raft_consensus.cc:2454] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 696ff01aee864aeda637787819824472 in term 0.
I20260808 09:57:55.569047 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc97efbfad943b98cb3dc53b9ec5d0f" candidate_uuid: "696ff01aee864aeda637787819824472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "623e8c4e79c3453d88206001b34dea73" is_pre_election: true
I20260808 09:57:55.569177 26767 raft_consensus.cc:2454] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 696ff01aee864aeda637787819824472 in term 0.
I20260808 09:57:55.569317 26879 leader_election.cc:302] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 696ff01aee864aeda637787819824472, 891e1a450fd4479f9fd1db8936354f4e; no voters:
I20260808 09:57:55.569427 27328 raft_consensus.cc:2781] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:57:55.569480 27328 raft_consensus.cc:482] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:57:55.569514 27328 raft_consensus.cc:3037] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:55.570329 27328 raft_consensus.cc:504] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.570477 27328 leader_election.cc:288] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [CANDIDATE]: Term 1 election: Requested vote from peers 623e8c4e79c3453d88206001b34dea73 (127.24.71.193:41225), 891e1a450fd4479f9fd1db8936354f4e (127.24.71.195:41989)
I20260808 09:57:55.570668 26767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc97efbfad943b98cb3dc53b9ec5d0f" candidate_uuid: "696ff01aee864aeda637787819824472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "623e8c4e79c3453d88206001b34dea73"
I20260808 09:57:55.570678 27220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bc97efbfad943b98cb3dc53b9ec5d0f" candidate_uuid: "696ff01aee864aeda637787819824472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "891e1a450fd4479f9fd1db8936354f4e"
I20260808 09:57:55.570745 26767 raft_consensus.cc:3037] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:55.570767 27220 raft_consensus.cc:3037] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:55.571413 27220 raft_consensus.cc:2454] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 696ff01aee864aeda637787819824472 in term 1.
I20260808 09:57:55.571440 26767 raft_consensus.cc:2454] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 696ff01aee864aeda637787819824472 in term 1.
I20260808 09:57:55.571640 26879 leader_election.cc:302] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 696ff01aee864aeda637787819824472, 891e1a450fd4479f9fd1db8936354f4e; no voters:
I20260808 09:57:55.571758 27328 raft_consensus.cc:2781] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:57:55.571832 27328 raft_consensus.cc:686] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [term 1 LEADER]: Becoming Leader. State: Replica: 696ff01aee864aeda637787819824472, State: Running, Role: LEADER
I20260808 09:57:55.571885 27328 consensus_queue.cc:237] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } }
I20260808 09:57:55.572201 27337 tablet_replica.cc:439] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472: TxnStatusTablet state changed. Reason: New leader 696ff01aee864aeda637787819824472. Latest consensus state: current_term: 1 leader_uuid: "696ff01aee864aeda637787819824472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } }
I20260808 09:57:55.572285 27337 tablet_replica.cc:442] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472: This TxnStatusTablet replica's current role is: LEADER
I20260808 09:57:55.572449 27389 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 09:57:55.572582 27389 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 09:57:55.572595 26529 catalog_manager.cc:5495] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 696ff01aee864aeda637787819824472 (127.24.71.194). New cstate: current_term: 1 leader_uuid: "696ff01aee864aeda637787819824472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } health_report { overall_health: UNKNOWN } } }
I20260808 09:57:55.582726 27313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.580166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48466 (local address 127.24.71.194:39375)
0808 09:57:55.580240 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:55.580242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:55.580250 (+ 8us) server_negotiation.cc:407] Connection header received
0808 09:57:55.580272 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:55.580273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:55.580283 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:55.580332 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:57:55.580504 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.580963 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.582070 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.582243 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.582293 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.582495 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:57:55.582522 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:57:55.582560 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:55.582647 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 09:57:55.582664 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 09:57:55.582788 27377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.579910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:39375 (local address 127.0.0.1:48466)
0808 09:57:55.579996 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:55.580011 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:55.580066 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:55.580365 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:55.580366 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:55.580368 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 09:57:55.580427 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.580429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.581041 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.581042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.581986 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.581988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.582315 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.582316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.582385 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.582404 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 09:57:55.582582 (+ 178us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 09:57:55.582590 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 09:57:55.582645 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 09:57:55.582699 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 09:57:55.584012 26767 raft_consensus.cc:1261] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73 [term 1 FOLLOWER]: Refusing update from remote peer 696ff01aee864aeda637787819824472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:57:55.584049 27220 raft_consensus.cc:1261] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e [term 1 FOLLOWER]: Refusing update from remote peer 696ff01aee864aeda637787819824472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:57:55.584268 27328 consensus_queue.cc:1035] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:57:55.584399 27337 consensus_queue.cc:1035] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:57:55.585058 27326 tablet_replica.cc:439] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73: TxnStatusTablet state changed. Reason: New leader 696ff01aee864aeda637787819824472. Latest consensus state: current_term: 1 leader_uuid: "696ff01aee864aeda637787819824472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } }
I20260808 09:57:55.585067 27334 tablet_replica.cc:439] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e: TxnStatusTablet state changed. Reason: New leader 696ff01aee864aeda637787819824472. Latest consensus state: current_term: 1 leader_uuid: "696ff01aee864aeda637787819824472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } }
I20260808 09:57:55.585148 27334 tablet_replica.cc:442] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:55.585148 27326 tablet_replica.cc:442] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:55.585860 27337 tablet_replica.cc:439] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "696ff01aee864aeda637787819824472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } }
I20260808 09:57:55.585937 27337 tablet_replica.cc:442] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472: This TxnStatusTablet replica's current role is: LEADER
I20260808 09:57:55.586206 27326 tablet_replica.cc:439] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "696ff01aee864aeda637787819824472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } }
I20260808 09:57:55.586239 27337 tablet_replica.cc:439] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "696ff01aee864aeda637787819824472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } }
I20260808 09:57:55.586287 27326 tablet_replica.cc:442] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 623e8c4e79c3453d88206001b34dea73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:55.586305 27337 tablet_replica.cc:442] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 696ff01aee864aeda637787819824472: This TxnStatusTablet replica's current role is: LEADER
I20260808 09:57:55.587028 27334 tablet_replica.cc:439] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "696ff01aee864aeda637787819824472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623e8c4e79c3453d88206001b34dea73" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 41225 } } peers { permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 } } peers { permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 } } }
I20260808 09:57:55.587121 27334 tablet_replica.cc:442] T 3bc97efbfad943b98cb3dc53b9ec5d0f P 891e1a450fd4479f9fd1db8936354f4e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:55.590555 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.587989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46542 (local address 127.24.71.193:41225)
0808 09:57:55.588046 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:55.588048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:55.588092 (+ 44us) server_negotiation.cc:407] Connection header received
0808 09:57:55.588163 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:55.588164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:55.588185 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:55.588268 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:57:55.588343 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.589075 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.589758 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.590059 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.590129 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.590237 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:57:55.590369 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:57:55.590439 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:55.590466 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 09:57:55.590485 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 09:57:55.602123 27313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.598672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:57837 (local address 127.24.71.194:39375)
0808 09:57:55.599713 (+ 1041us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:55.599715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:55.599725 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:57:55.599753 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:55.599754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:55.599766 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:55.599828 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:57:55.600010 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.600491 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.601342 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.601550 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.601627 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.601835 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:57:55.601877 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:57:55.601937 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:55.602004 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 09:57:55.602029 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1011}
I20260808 09:57:55.602145 27398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.598554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:39375 (local address 127.24.71.193:57837)
0808 09:57:55.598757 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:55.598770 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:55.598830 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:55.599847 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:55.599848 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:55.599849 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 09:57:55.599911 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.599912 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.600583 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.600585 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.601234 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.601237 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.601646 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.601648 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.601710 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.601728 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 09:57:55.601939 (+ 211us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 09:57:55.601942 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:57:55.602004 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 09:57:55.602051 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":117,"threads_started":1}
I20260808 09:57:55.605007 27220 raft_consensus.cc:1261] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e [term 1 FOLLOWER]: Refusing update from remote peer 623e8c4e79c3453d88206001b34dea73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:57:55.605070 26988 raft_consensus.cc:1261] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472 [term 1 FOLLOWER]: Refusing update from remote peer 623e8c4e79c3453d88206001b34dea73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:57:55.605414 27326 consensus_queue.cc:1035] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "696ff01aee864aeda637787819824472" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:57:55.605567 27366 consensus_queue.cc:1035] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "891e1a450fd4479f9fd1db8936354f4e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:57:55.616509 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.613726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:54577 (local address 127.24.71.193:41225)
0808 09:57:55.613764 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:55.613766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:55.613774 (+ 8us) server_negotiation.cc:407] Connection header received
0808 09:57:55.613859 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:55.613860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:55.613870 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:55.613926 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:57:55.614058 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.614530 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.615780 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.615990 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.616074 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.616249 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:57:55.616285 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:57:55.616355 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:55.616418 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 09:57:55.616439 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 09:57:55.616549 27404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.613501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:41225 (local address 127.24.71.194:54577)
0808 09:57:55.613701 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:55.613714 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:55.613772 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:55.613930 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:55.613931 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:55.613934 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 09:57:55.613985 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.613987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.614621 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.614622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.615691 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:55.615694 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.616091 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.616093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:55.616151 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.616165 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 09:57:55.616356 (+ 191us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 09:57:55.616359 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:57:55.616413 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 09:57:55.616468 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":126,"threads_started":1}
I20260808 09:57:55.626242 26527 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:57:55.626353 26527 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:57:55.627017 26527 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be79c9d89f5141089fa12bc7df770efa: Sending DeleteTablet for 3 replicas of tablet 3a718b26655c444c874c4eb2d49e57c3
I20260808 09:57:55.627271 27191 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a718b26655c444c874c4eb2d49e57c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:57:55 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:57818
I20260808 09:57:55.627285 26963 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a718b26655c444c874c4eb2d49e57c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:57:55 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:48438
I20260808 09:57:55.627369 27358 tablet_replica.cc:330] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e: stopping tablet replica
I20260808 09:57:55.627408 27357 tablet_replica.cc:330] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472: stopping tablet replica
I20260808 09:57:55.627440 27358 raft_consensus.cc:2229] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:57:55.627465 27357 raft_consensus.cc:2229] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:57:55.627487 27358 raft_consensus.cc:2258] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:57:55.627506 27357 raft_consensus.cc:2258] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:57:55.627810 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a718b26655c444c874c4eb2d49e57c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:57:55 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:46528
I20260808 09:57:55.627889 27356 tablet_replica.cc:330] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73: stopping tablet replica
I20260808 09:57:55.627887 27357 ts_tablet_manager.cc:1905] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:57:55.627931 27356 raft_consensus.cc:2229] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [term 1 LEADER]: Raft consensus shutting down.
I20260808 09:57:55.628005 27356 raft_consensus.cc:2258] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:57:55.628506 27356 ts_tablet_manager.cc:1905] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:57:55.628506 27358 ts_tablet_manager.cc:1905] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:57:55.629827 27357 ts_tablet_manager.cc:1918] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:57:55.629890 27357 log.cc:1196] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/3a718b26655c444c874c4eb2d49e57c3
I20260808 09:57:55.630084 27358 ts_tablet_manager.cc:1918] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:57:55.630084 27356 ts_tablet_manager.cc:1918] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:57:55.630137 27356 log.cc:1196] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-0/wal/wals/3a718b26655c444c874c4eb2d49e57c3
I20260808 09:57:55.630137 27358 log.cc:1196] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/3a718b26655c444c874c4eb2d49e57c3
I20260808 09:57:55.630191 27357 ts_tablet_manager.cc:1939] T 3a718b26655c444c874c4eb2d49e57c3 P 696ff01aee864aeda637787819824472: Deleting consensus metadata
I20260808 09:57:55.630363 27356 ts_tablet_manager.cc:1939] T 3a718b26655c444c874c4eb2d49e57c3 P 623e8c4e79c3453d88206001b34dea73: Deleting consensus metadata
I20260808 09:57:55.630363 27358 ts_tablet_manager.cc:1939] T 3a718b26655c444c874c4eb2d49e57c3 P 891e1a450fd4479f9fd1db8936354f4e: Deleting consensus metadata
I20260808 09:57:55.630565 26505 catalog_manager.cc:4841] TS 696ff01aee864aeda637787819824472 (127.24.71.194:39375): tablet 3a718b26655c444c874c4eb2d49e57c3 (table test-table [id=9f0133ad6a9840d3aff7358abb826607]) successfully deleted
I20260808 09:57:55.630666 26506 catalog_manager.cc:4841] TS 891e1a450fd4479f9fd1db8936354f4e (127.24.71.195:41989): tablet 3a718b26655c444c874c4eb2d49e57c3 (table test-table [id=9f0133ad6a9840d3aff7358abb826607]) successfully deleted
I20260808 09:57:55.630743 26506 catalog_manager.cc:4841] TS 623e8c4e79c3453d88206001b34dea73 (127.24.71.193:41225): tablet 3a718b26655c444c874c4eb2d49e57c3 (table test-table [id=9f0133ad6a9840d3aff7358abb826607]) successfully deleted
Aug 08 09:57:55 dist-test-slave-gw5c krb5kdc[26465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183074, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.71.193@KRBTEST.COM
I20260808 09:57:55.650410 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.631659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46546 (local address 127.24.71.193:41225)
0808 09:57:55.631709 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:55.631712 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:55.639622 (+ 7910us) server_negotiation.cc:407] Connection header received
0808 09:57:55.639733 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:55.639735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:55.639747 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:55.639778 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:55.640580 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.641348 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.642443 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.642737 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.642778 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.646777 (+ 3999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:55.646788 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:55.646789 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:55.646797 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:55.648915 (+ 2118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:55.649364 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:55.649369 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:55.649370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:55.649445 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:55.649647 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:55.649648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:55.649648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:55.649822 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:55.649946 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:55.650202 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 09:57:55.650294 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 09:57:55.651033 26825 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46546
I20260808 09:57:55.660413 27379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:55.652153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34992 (local address 127.24.71.254:37657)
0808 09:57:55.652198 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:55.652200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:55.652383 (+ 183us) server_negotiation.cc:407] Connection header received
0808 09:57:55.652482 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:55.652483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:55.652497 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:55.652528 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:55.653227 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.654050 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.655163 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:55.655525 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:55.655568 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:55.657121 (+ 1553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:55.657122 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:55.657122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:55.657130 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:55.658862 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:55.659300 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:55.659301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:55.659302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:55.659359 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:55.659776 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:55.659777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:55.659777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:55.659914 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:55.660008 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:55.660216 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 09:57:55.660311 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 09:57:55.661197 26527 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34992
I20260808 09:57:55.662192 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 26637
I20260808 09:57:55.671929 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 26849
I20260808 09:57:55.689035 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 27093
I20260808 09:57:55.697039 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 26484
2026-08-08T09:57:55Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2953 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:57:55 dist-test-slave-gw5c krb5kdc[27419](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:57:55 dist-test-slave-gw5c krb5kdc[27419](info): set up 2 sockets
Aug 08 09:57:55 dist-test-slave-gw5c krb5kdc[27419](info): commencing operation
krb5kdc: starting...
W20260808 09:57:56.964130 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:57:57 dist-test-slave-gw5c krb5kdc[27419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183077, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:57:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:57:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:57:57.090065 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:43865
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:44529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:43865
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:57.176936 27444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:57.177170 27444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:57.177196 27444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:57.178347 27444 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:57:57.178399 27444 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 09:57:57.178416 27444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:57.178431 27444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:57.178447 27444 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:57:57.178460 27444 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:57:57.180065 27444 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:44529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:43865
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:43865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:57.180281 27444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:57.180483 27444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:57.185485 27457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:57.185571 27444 server_base.cc:1034] running on GCE node
W20260808 09:57:57.185573 27453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:57.185513 27452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:57.185990 27444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:57.186309 27444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:57.187466 27444 hybrid_clock.cc:648] HybridClock initialized: now 1786183077187442 us; error 41 us; skew 500 ppm
Aug 08 09:57:57 dist-test-slave-gw5c krb5kdc[27419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183077, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:57.190040 27444 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:57:57.190551 27444 webserver.cc:460] Webserver started at http://127.24.71.254:39217/ using document root <none> and password file <none>
I20260808 09:57:57.190810 27444 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:57.190881 27444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:57.191047 27444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:57.192248 27444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "c3216aed82764591b387600f3352cfb2"
format_stamp: "Formatted at 2026-08-08 09:57:57 on dist-test-slave-gw5c"
server_key: "c9c6af05891a76ce1b3105e976ccd60c"
server_key_iv: "3a7c6afbbefb9b4f10447889eb90b9ca"
server_key_version: "encryptionkey@0"
I20260808 09:57:57.192651 27444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "c3216aed82764591b387600f3352cfb2"
format_stamp: "Formatted at 2026-08-08 09:57:57 on dist-test-slave-gw5c"
server_key: "c9c6af05891a76ce1b3105e976ccd60c"
server_key_iv: "3a7c6afbbefb9b4f10447889eb90b9ca"
server_key_version: "encryptionkey@0"
I20260808 09:57:57.194025 27444 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 09:57:57.194824 27469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:57.195010 27444 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 09:57:57.195123 27444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "c3216aed82764591b387600f3352cfb2"
format_stamp: "Formatted at 2026-08-08 09:57:57 on dist-test-slave-gw5c"
server_key: "c9c6af05891a76ce1b3105e976ccd60c"
server_key_iv: "3a7c6afbbefb9b4f10447889eb90b9ca"
server_key_version: "encryptionkey@0"
I20260808 09:57:57.195201 27444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:57.214262 27444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:57.216434 27444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:57.216612 27444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:57.221794 27444 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:43865
I20260808 09:57:57.221858 27557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:43865 every 8 connection(s)
I20260808 09:57:57.222236 27444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:57:57.222910 27558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:57.225266 27558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2: Bootstrap starting.
I20260808 09:57:57.225857 27558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:57.226187 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 27444
I20260808 09:57:57.226198 27558 log.cc:824] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2: Log is configured to *not* fsync() on all Append() calls
I20260808 09:57:57.226276 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:57:57.226464 24863 external_mini_cluster.cc:1428] Setting key e3ec852fa3305ce4311b2fc35ce6fc26
I20260808 09:57:57.227038 27558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2: No bootstrap required, opened a new log
I20260808 09:57:57.229336 27558 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3216aed82764591b387600f3352cfb2" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43865 } }
I20260808 09:57:57.229509 27558 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:57.229575 27558 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3216aed82764591b387600f3352cfb2, State: Initialized, Role: FOLLOWER
I20260808 09:57:57.229785 27558 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3216aed82764591b387600f3352cfb2" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43865 } }
I20260808 09:57:57.229871 27558 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:57:57.229894 27558 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:57:57.229943 27558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:57.230509 27558 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3216aed82764591b387600f3352cfb2" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43865 } }
I20260808 09:57:57.230635 27558 leader_election.cc:302] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3216aed82764591b387600f3352cfb2; no voters:
I20260808 09:57:57.230820 27558 leader_election.cc:288] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:57:57.230868 27564 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:57:57.231047 27564 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [term 1 LEADER]: Becoming Leader. State: Replica: c3216aed82764591b387600f3352cfb2, State: Running, Role: LEADER
I20260808 09:57:57.231112 27558 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:57:57.231189 27564 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3216aed82764591b387600f3352cfb2" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43865 } }
I20260808 09:57:57.231571 27569 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3216aed82764591b387600f3352cfb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3216aed82764591b387600f3352cfb2" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43865 } } }
I20260808 09:57:57.231670 27569 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [sys.catalog]: This master's current role is: LEADER
I20260808 09:57:57.231559 27564 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3216aed82764591b387600f3352cfb2. Latest consensus state: current_term: 1 leader_uuid: "c3216aed82764591b387600f3352cfb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3216aed82764591b387600f3352cfb2" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43865 } } }
I20260808 09:57:57.231880 27564 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2 [sys.catalog]: This master's current role is: LEADER
I20260808 09:57:57.232016 27576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:57:57.232718 27576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 09:57:57 dist-test-slave-gw5c krb5kdc[27419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183077, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:57.236287 27576 catalog_manager.cc:1347] Generated new cluster ID: 89fc9cf5e9484e35b485085e6c2acd0f
I20260808 09:57:57.236363 27576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:57:57.240314 27563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.227008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43052 (local address 127.24.71.254:43865)
0808 09:57:57.227258 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:57.227266 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:57.227292 (+ 26us) server_negotiation.cc:407] Connection header received
0808 09:57:57.229318 (+ 2026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:57.229325 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:57.229376 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:57.229526 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:57.230232 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.231553 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.232864 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.233494 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.233612 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.236244 (+ 2632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:57.236249 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:57.236249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:57.236263 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:57.238320 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.238688 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.238691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.238691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.238811 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.239018 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.239019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.239019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.239309 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:57.239473 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:57.239959 (+ 486us) server_negotiation.cc:299] Negotiation successful
0808 09:57:57.240097 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":77,"threads_started":1}
I20260808 09:57:57.245404 27576 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:57:57.246111 27576 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:57:57.254424 27576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2: Generated new TSK 0
I20260808 09:57:57.254652 27576 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 09:57:57.290223 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43865
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:44529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:57.377874 27597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:57.378178 27597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:57.378221 27597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:57.380226 27597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:57.380300 27597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:57.380337 27597 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 09:57:57.380358 27597 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 09:57:57.380412 27597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:57:57.383111 27597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:44529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.71.254:43865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:57.383468 27597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:57.383737 27597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:57.389181 27606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:57.389183 27605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:57.389184 27611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:57.389374 27597 server_base.cc:1034] running on GCE node
I20260808 09:57:57.389635 27597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:57.389896 27597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:57.391045 27597 hybrid_clock.cc:648] HybridClock initialized: now 1786183077391036 us; error 30 us; skew 500 ppm
Aug 08 09:57:57 dist-test-slave-gw5c krb5kdc[27419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183077, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:57.393654 27597 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 09:57:57.394129 27597 webserver.cc:460] Webserver started at http://127.24.71.193:37243/ using document root <none> and password file <none>
I20260808 09:57:57.394387 27597 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:57.394459 27597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:57.394609 27597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:57.395735 27597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "c84ad11af230488887d604a8acabf378"
format_stamp: "Formatted at 2026-08-08 09:57:57 on dist-test-slave-gw5c"
server_key: "c8d814485d2cefd651ad2dcca9e83408"
server_key_iv: "dc4ed15245c3ad4cc77afdc16e1ab18b"
server_key_version: "encryptionkey@0"
I20260808 09:57:57.396106 27597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "c84ad11af230488887d604a8acabf378"
format_stamp: "Formatted at 2026-08-08 09:57:57 on dist-test-slave-gw5c"
server_key: "c8d814485d2cefd651ad2dcca9e83408"
server_key_iv: "dc4ed15245c3ad4cc77afdc16e1ab18b"
server_key_version: "encryptionkey@0"
I20260808 09:57:57.397574 27597 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 09:57:57.398350 27627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:57.398536 27597 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:57:57.398646 27597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "c84ad11af230488887d604a8acabf378"
format_stamp: "Formatted at 2026-08-08 09:57:57 on dist-test-slave-gw5c"
server_key: "c8d814485d2cefd651ad2dcca9e83408"
server_key_iv: "dc4ed15245c3ad4cc77afdc16e1ab18b"
server_key_version: "encryptionkey@0"
I20260808 09:57:57.398721 27597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:57.421442 27597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:57.423532 27597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:57.423709 27597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:57.424256 27597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:57:57.424324 27597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:57.424387 27597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:57:57.424412 27597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:57.431208 27597 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:43221
I20260808 09:57:57.431315 27803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:43221 every 8 connection(s)
I20260808 09:57:57.431691 27597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
Aug 08 09:57:57 dist-test-slave-gw5c krb5kdc[27419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183077, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:57.435242 27563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.424874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:47937 (local address 127.24.71.254:43865)
0808 09:57:57.424930 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:57.424932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:57.425199 (+ 267us) server_negotiation.cc:407] Connection header received
0808 09:57:57.425789 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:57.425791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:57.425812 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:57.425899 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:57.426890 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.427822 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.429472 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.429863 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.429954 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.432756 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:57.432758 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:57.432758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:57.432765 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:57.434063 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.434454 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.434456 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.434456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.434511 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.434726 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.434726 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.434726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.434834 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:57.434886 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:57.435105 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 09:57:57.435177 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 09:57:57.435519 27640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.424873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43865 (local address 127.24.71.193:47937)
0808 09:57:57.425065 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:57.425104 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:57.425637 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:57.426008 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:57.426014 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:57.426423 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:57.426760 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.426768 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.427944 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.427946 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.429370 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.429374 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.429980 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.429981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.430143 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.430772 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:57.430790 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:57.432660 (+ 1870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:57.434140 (+ 1480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:57.434147 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:57.434149 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:57.434385 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:57.434570 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:57.434571 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:57.434571 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:57.434672 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:57.434890 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:57.434894 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:57.435011 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 09:57:57.435094 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 09:57:57.435222 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":103,"threads_started":1}
I20260808 09:57:57.436070 27804 heartbeater.cc:347] Connected to a master server at 127.24.71.254:43865
I20260808 09:57:57.436177 27804 heartbeater.cc:464] Registering TS with master...
I20260808 09:57:57.436393 27804 heartbeater.cc:511] Master 127.24.71.254:43865 requested a full tablet report, sending...
I20260808 09:57:57.436996 27492 ts_manager.cc:194] Registered new tserver with Master: c84ad11af230488887d604a8acabf378 (127.24.71.193:43221)
I20260808 09:57:57.437497 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 27597
I20260808 09:57:57.437594 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:57:57.437770 24863 external_mini_cluster.cc:1428] Setting key e2f23e627706c5fc7b8707e683c21e22
I20260808 09:57:57.437976 27492 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:47937
I20260808 09:57:57.443756 27563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.437176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:50433 (local address 127.24.71.254:43865)
0808 09:57:57.437222 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:57.437224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:57.437433 (+ 209us) server_negotiation.cc:407] Connection header received
0808 09:57:57.437487 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:57.437489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:57.437499 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:57.437569 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:57.437914 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.438679 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.439766 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.439947 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.440008 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.440990 (+ 982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:57.440991 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:57.440992 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:57.440999 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:57.442585 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.442920 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.442922 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.442923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.442995 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.443192 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.443193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.443194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.443309 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:57.443384 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:57.443584 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 09:57:57.443665 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 09:57:57.443765 27813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.437179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43865 (local address 127.24.71.193:50433)
0808 09:57:57.437345 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:57.437357 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:57.437425 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:57.437583 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:57.437584 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:57.437778 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:57.437834 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.437835 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.438794 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.438796 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.439678 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.439681 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.440027 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.440028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.440111 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.440607 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:57.440611 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:57.440894 (+ 283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:57.442668 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:57.442669 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:57.442670 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:57.442840 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:57.443063 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:57.443064 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:57.443064 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:57.443116 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:57.443387 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:57.443427 (+ 40us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:57.443480 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 09:57:57.443557 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 09:57:57.443664 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":81,"threads_started":1}
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 09:57:57.467384 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43865
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:44529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:57.552246 27817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:57.552479 27817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:57.552538 27817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:57.553710 27817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:57.553751 27817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:57.553773 27817 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 09:57:57.553785 27817 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 09:57:57.553802 27817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:57:57.555248 27817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:44529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.71.254:43865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:57.555514 27817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:57.555718 27817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:57.560731 27826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:57.560801 27827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:57.560801 27829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:57.561084 27817 server_base.cc:1034] running on GCE node
I20260808 09:57:57.561321 27817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:57.561584 27817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:57.562723 27817 hybrid_clock.cc:648] HybridClock initialized: now 1786183077562709 us; error 24 us; skew 500 ppm
Aug 08 09:57:57 dist-test-slave-gw5c krb5kdc[27419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183077, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:57.565447 27817 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 09:57:57.565907 27817 webserver.cc:460] Webserver started at http://127.24.71.194:45175/ using document root <none> and password file <none>
I20260808 09:57:57.566147 27817 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:57.566195 27817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:57.566402 27817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:57.567582 27817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "eb41ab96fd624529bc1bae2601fa2747"
format_stamp: "Formatted at 2026-08-08 09:57:57 on dist-test-slave-gw5c"
server_key: "b6bcc20bf6cf963f9a529f5160241daa"
server_key_iv: "8da2712ec74dd2c052f33a839d26717c"
server_key_version: "encryptionkey@0"
I20260808 09:57:57.567962 27817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "eb41ab96fd624529bc1bae2601fa2747"
format_stamp: "Formatted at 2026-08-08 09:57:57 on dist-test-slave-gw5c"
server_key: "b6bcc20bf6cf963f9a529f5160241daa"
server_key_iv: "8da2712ec74dd2c052f33a839d26717c"
server_key_version: "encryptionkey@0"
I20260808 09:57:57.569420 27817 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 09:57:57.570420 27838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:57.570626 27817 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:57:57.570724 27817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "eb41ab96fd624529bc1bae2601fa2747"
format_stamp: "Formatted at 2026-08-08 09:57:57 on dist-test-slave-gw5c"
server_key: "b6bcc20bf6cf963f9a529f5160241daa"
server_key_iv: "8da2712ec74dd2c052f33a839d26717c"
server_key_version: "encryptionkey@0"
I20260808 09:57:57.570797 27817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:57.585986 27817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:57.588516 27817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:57.588680 27817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:57.589243 27817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:57:57.589282 27817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:57.589306 27817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:57:57.589323 27817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:57.596419 27817 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:39881
I20260808 09:57:57.596500 28009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:39881 every 8 connection(s)
Aug 08 09:57:57 dist-test-slave-gw5c krb5kdc[27419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183077, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:57.596845 27817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:57:57.600260 27563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.589826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:60467 (local address 127.24.71.254:43865)
0808 09:57:57.589908 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:57.589911 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:57.590136 (+ 225us) server_negotiation.cc:407] Connection header received
0808 09:57:57.590662 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:57.590663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:57.590680 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:57.590767 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:57.591781 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.592651 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.594224 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.594551 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.594636 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.597331 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:57.597333 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:57.597334 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:57.597343 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:57.598707 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.599165 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.599166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.599167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.599237 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.599569 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.599570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.599570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.599700 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:57.599784 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:57.600076 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 09:57:57.600169 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 09:57:57.600447 27852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.589806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43865 (local address 127.24.71.194:60467)
0808 09:57:57.589986 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:57.590028 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:57.590541 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:57.590861 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:57.590866 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:57.591325 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:57.591660 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.591666 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.592797 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.592798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.594091 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.594094 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.594639 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.594640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.594748 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.595330 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:57.595338 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:57.597202 (+ 1864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:57.598820 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:57.598827 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:57.598830 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:57.599079 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:57.599315 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:57.599316 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:57.599316 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:57.599497 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:57.599781 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:57.599790 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:57.599934 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 09:57:57.600039 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 09:57:57.600208 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":115,"threads_started":1}
I20260808 09:57:57.600932 28010 heartbeater.cc:347] Connected to a master server at 127.24.71.254:43865
I20260808 09:57:57.601048 28010 heartbeater.cc:464] Registering TS with master...
I20260808 09:57:57.601226 28010 heartbeater.cc:511] Master 127.24.71.254:43865 requested a full tablet report, sending...
I20260808 09:57:57.601600 27493 ts_manager.cc:194] Registered new tserver with Master: eb41ab96fd624529bc1bae2601fa2747 (127.24.71.194:39881)
I20260808 09:57:57.602144 27493 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:60467
I20260808 09:57:57.603446 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 27817
I20260808 09:57:57.603552 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:57:57.603736 24863 external_mini_cluster.cc:1428] Setting key 9c96e821dce5bc15b078b57b4a0e3780
I20260808 09:57:57.608035 27563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.602028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:39203 (local address 127.24.71.254:43865)
0808 09:57:57.602075 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:57.602077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:57.602219 (+ 142us) server_negotiation.cc:407] Connection header received
0808 09:57:57.602269 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:57.602270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:57.602286 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:57.602343 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:57.602672 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.603212 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.604132 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.604384 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.604457 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.605412 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:57.605413 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:57.605414 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:57.605421 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:57.606832 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.607239 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.607239 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.607240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.607325 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.607561 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.607561 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.607561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.607696 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:57.607752 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:57.607915 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 09:57:57.607975 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 09:57:57.608161 28018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.601985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43865 (local address 127.24.71.194:39203)
0808 09:57:57.602139 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:57.602150 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:57.602217 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:57.602360 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:57.602361 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:57.602537 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:57.602590 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.602591 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.603310 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.603311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.604058 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.604061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.604475 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.604476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.604533 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.605012 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:57.605017 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:57.605322 (+ 305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:57.606916 (+ 1594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:57.606917 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:57.606917 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:57.607154 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:57.607415 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:57.607416 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:57.607417 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:57.607498 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:57.607763 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:57.607764 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:57.607818 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 09:57:57.607891 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 09:57:57.608011 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 09:57:57.630563 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43865
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:44529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:57:57.714775 28022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:57:57.715026 28022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:57:57.715068 28022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:57:57.716310 28022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:57:57.716380 28022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:57:57.716415 28022 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 09:57:57.716446 28022 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 09:57:57.716480 28022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:57:57.718065 28022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:44529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.71.254:43865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:57:57.718343 28022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:57:57.718586 28022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:57:57.723893 28031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:57:57.723881 28032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:57.723922 28022 server_base.cc:1034] running on GCE node
W20260808 09:57:57.723881 28035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:57:57.724326 28022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:57:57.724587 28022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:57:57.725755 28022 hybrid_clock.cc:648] HybridClock initialized: now 1786183077725727 us; error 65 us; skew 500 ppm
Aug 08 09:57:57 dist-test-slave-gw5c krb5kdc[27419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183077, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:57:57.728458 28022 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 09:57:57.728963 28022 webserver.cc:460] Webserver started at http://127.24.71.195:34387/ using document root <none> and password file <none>
I20260808 09:57:57.729209 28022 fs_manager.cc:359] Metadata directory not provided
I20260808 09:57:57.729281 28022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:57:57.729436 28022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:57:57.730528 28022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "24cc5e62e64348b3a275fb9832f0e8e0"
format_stamp: "Formatted at 2026-08-08 09:57:57 on dist-test-slave-gw5c"
server_key: "da9d80c9d708c07f5a87909f0742eee5"
server_key_iv: "81d6cf1c9d50dc9ca54abad2bb910420"
server_key_version: "encryptionkey@0"
I20260808 09:57:57.730968 28022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "24cc5e62e64348b3a275fb9832f0e8e0"
format_stamp: "Formatted at 2026-08-08 09:57:57 on dist-test-slave-gw5c"
server_key: "da9d80c9d708c07f5a87909f0742eee5"
server_key_iv: "81d6cf1c9d50dc9ca54abad2bb910420"
server_key_version: "encryptionkey@0"
I20260808 09:57:57.732632 28022 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 09:57:57.733567 28043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:57.733762 28022 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:57:57.733867 28022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "24cc5e62e64348b3a275fb9832f0e8e0"
format_stamp: "Formatted at 2026-08-08 09:57:57 on dist-test-slave-gw5c"
server_key: "da9d80c9d708c07f5a87909f0742eee5"
server_key_iv: "81d6cf1c9d50dc9ca54abad2bb910420"
server_key_version: "encryptionkey@0"
I20260808 09:57:57.733964 28022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:57:57.757606 28022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:57:57.760106 28022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:57:57.760278 28022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:57:57.760898 28022 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:57:57.760962 28022 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:57.760998 28022 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:57:57.761018 28022 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 09:57:57 dist-test-slave-gw5c krb5kdc[27419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183077, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:57.768230 28022 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:45457
I20260808 09:57:57.768285 28212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:45457 every 8 connection(s)
I20260808 09:57:57.768604 28022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:57:57.770521 27563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.761362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:34379 (local address 127.24.71.254:43865)
0808 09:57:57.761433 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:57.761436 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:57.761672 (+ 236us) server_negotiation.cc:407] Connection header received
0808 09:57:57.762204 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:57.762206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:57.762219 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:57.762286 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:57.763195 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.764092 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.765169 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.765385 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.765471 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.767806 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:57.767808 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:57.767808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:57.767816 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:57.769393 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.769757 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.769758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.769758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.769814 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.770012 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.770012 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.770013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.770107 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:57.770154 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:57.770384 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 09:57:57.770448 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 09:57:57.770718 28055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.761350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43865 (local address 127.24.71.195:34379)
0808 09:57:57.761532 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:57.761574 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:57.762091 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:57.762363 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:57.762366 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:57.762760 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:57.763078 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.763085 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.764201 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.764201 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.765069 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.765072 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.765504 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.765505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.765627 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.766158 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:57.766167 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:57.767712 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:57.769473 (+ 1761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:57.769478 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:57.769479 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:57.769688 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:57.769875 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:57.769876 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:57.769876 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:57.769972 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:57.770156 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:57.770160 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:57.770266 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 09:57:57.770356 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 09:57:57.770485 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":114,"threads_started":1}
I20260808 09:57:57.771293 28213 heartbeater.cc:347] Connected to a master server at 127.24.71.254:43865
I20260808 09:57:57.771381 28213 heartbeater.cc:464] Registering TS with master...
I20260808 09:57:57.771610 28213 heartbeater.cc:511] Master 127.24.71.254:43865 requested a full tablet report, sending...
I20260808 09:57:57.771992 27493 ts_manager.cc:194] Registered new tserver with Master: 24cc5e62e64348b3a275fb9832f0e8e0 (127.24.71.195:45457)
I20260808 09:57:57.772550 27493 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:34379
I20260808 09:57:57.776824 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 28022
I20260808 09:57:57.776927 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:57:57.777110 24863 external_mini_cluster.cc:1428] Setting key f0b7aae3fd22ea5570adbab52d68c4cf
I20260808 09:57:57.777865 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 09:57:57.778023 27563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.772565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:49119 (local address 127.24.71.254:43865)
0808 09:57:57.772608 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:57.772610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:57.772676 (+ 66us) server_negotiation.cc:407] Connection header received
0808 09:57:57.772739 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:57.772740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:57.772750 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:57.772805 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:57.773135 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.773599 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.774362 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.774659 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.774722 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.775763 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:57.775765 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:57.775765 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:57.775772 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:57.776885 (+ 1113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.777247 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.777248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.777248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.777310 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.777512 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.777513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.777513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.777624 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:57.777697 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:57.777856 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 09:57:57.777931 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 09:57:57.778040 28222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.772466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43865 (local address 127.24.71.195:49119)
0808 09:57:57.772614 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:57.772626 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:57.772689 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:57.772811 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:57.772812 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:57.773000 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:57.773054 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.773055 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.773712 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.773713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.774278 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.774280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.774730 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.774731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.774803 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.775265 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:57.775270 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:57.775679 (+ 409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:57.776974 (+ 1295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:57.776975 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:57.776975 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:57.777147 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:57.777379 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:57.777380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:57.777380 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:57.777438 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:57.777698 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:57.777700 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:57.777744 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 09:57:57.777830 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 09:57:57.777941 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":93,"threads_started":1}
Aug 08 09:57:57 dist-test-slave-gw5c krb5kdc[27419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183077, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 09:57:57 dist-test-slave-gw5c krb5kdc[27419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183077, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:57.803316 27563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.795223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43056 (local address 127.24.71.254:43865)
0808 09:57:57.795300 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:57.795302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:57.795311 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:57:57.795337 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:57.795337 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:57.795347 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:57.795445 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:57.796008 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.796500 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.797307 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.797560 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.797612 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.800520 (+ 2908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:57.800522 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:57.800522 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:57.800530 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:57.802217 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.802651 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.802652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.802652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.802709 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:57.802904 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:57.802905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:57.802905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:57.803008 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:57.803083 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:57.803177 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 09:57:57.803243 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 09:57:57.804816 27493 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43056:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:57:57.806385 27493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:57:57.813280 28252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.809278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38178 (local address 127.24.71.195:45457)
0808 09:57:57.809463 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:57.809468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:57.809483 (+ 15us) server_negotiation.cc:407] Connection header received
0808 09:57:57.809528 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:57.809530 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:57.809568 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:57.809642 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:57.809887 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.811022 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.812246 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.812796 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.812891 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.812965 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:57.813132 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 09:57:57.813171 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":80,"threads_started":1}
I20260808 09:57:57.813295 28250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.809029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:45457 (local address 127.0.0.1:38178)
0808 09:57:57.809416 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:57.809424 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:57.809466 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:57.809718 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:57.809719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:57.809722 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:57.809799 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.809801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.811118 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.811119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.812153 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.812156 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.812890 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.812891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.812988 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.813005 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 09:57:57.813114 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 09:57:57.813170 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"mutex_wait_us":35,"thread_start_us":92,"threads_started":1}
I20260808 09:57:57.813467 28248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.808975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:39881 (local address 127.0.0.1:33842)
0808 09:57:57.809186 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:57.809228 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:57.809304 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:57.809931 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:57.809932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:57.809934 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:57.809971 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.809972 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.811197 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.811198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.812291 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.812293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.813232 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.813233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.813294 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.813297 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:57:57.813346 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 09:57:57.813386 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":69,"threads_started":1}
I20260808 09:57:57.813717 28253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.809292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55200 (local address 127.24.71.193:43221)
0808 09:57:57.809474 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:57.809478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:57.809487 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:57:57.809527 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:57.809530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:57.809545 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:57.809642 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:57.809852 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.810657 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.812064 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.812850 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.812923 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.812979 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:57.813338 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 09:57:57.813621 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":74,"threads_started":1}
I20260808 09:57:57.813297 28247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.809029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:43221 (local address 127.0.0.1:55200)
0808 09:57:57.809245 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:57.809256 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:57.809304 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:57.809659 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:57.809662 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:57.809665 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:57.809756 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.809759 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.810753 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.810754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.811973 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:57.811977 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.813024 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.813026 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:57.813090 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.813095 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 09:57:57.813143 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 09:57:57.813187 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":102,"threads_started":1}
I20260808 09:57:57.813781 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:57.809083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33842 (local address 127.24.71.194:39881)
0808 09:57:57.809771 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:57.809775 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:57.809785 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:57:57.809824 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:57.809826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:57.809843 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:57.809918 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:57.810053 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.811110 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.812375 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:57.813084 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:57.813151 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:57.813198 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:57.813635 (+ 437us) server_negotiation.cc:299] Negotiation successful
0808 09:57:57.813678 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":86,"threads_started":1}
I20260808 09:57:57.814054 28116 tablet_service.cc:1467] Processing CreateTablet for tablet 853bedde1d034cb78c62d51098bc1ae2 (DEFAULT_TABLE table=test-table [id=136c9e68e9ec4d96816d673bc8b502d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:57.814393 27907 tablet_service.cc:1467] Processing CreateTablet for tablet 853bedde1d034cb78c62d51098bc1ae2 (DEFAULT_TABLE table=test-table [id=136c9e68e9ec4d96816d673bc8b502d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:57.814486 28116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 853bedde1d034cb78c62d51098bc1ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:57.814714 27907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 853bedde1d034cb78c62d51098bc1ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:57.817327 28255 tablet_bootstrap.cc:492] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0: Bootstrap starting.
I20260808 09:57:57.817821 28256 tablet_bootstrap.cc:492] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747: Bootstrap starting.
I20260808 09:57:57.817728 27706 tablet_service.cc:1467] Processing CreateTablet for tablet 853bedde1d034cb78c62d51098bc1ae2 (DEFAULT_TABLE table=test-table [id=136c9e68e9ec4d96816d673bc8b502d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:57.818135 27706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 853bedde1d034cb78c62d51098bc1ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:57.818331 28255 tablet_bootstrap.cc:654] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:57.818547 28256 tablet_bootstrap.cc:654] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:57.818696 28255 log.cc:824] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0: Log is configured to *not* fsync() on all Append() calls
I20260808 09:57:57.818917 28256 log.cc:824] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747: Log is configured to *not* fsync() on all Append() calls
I20260808 09:57:57.819496 28255 tablet_bootstrap.cc:492] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0: No bootstrap required, opened a new log
I20260808 09:57:57.819574 28255 ts_tablet_manager.cc:1397] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 09:57:57.819780 28256 tablet_bootstrap.cc:492] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747: No bootstrap required, opened a new log
I20260808 09:57:57.819851 28256 ts_tablet_manager.cc:1397] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:57:57.821597 28255 raft_consensus.cc:348] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:57.821710 28260 tablet_bootstrap.cc:492] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378: Bootstrap starting.
I20260808 09:57:57.821781 28255 raft_consensus.cc:374] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:57.821830 28255 raft_consensus.cc:729] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cc5e62e64348b3a275fb9832f0e8e0, State: Initialized, Role: FOLLOWER
I20260808 09:57:57.821777 28256 raft_consensus.cc:348] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:57.821923 28256 raft_consensus.cc:374] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:57.821969 28256 raft_consensus.cc:729] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb41ab96fd624529bc1bae2601fa2747, State: Initialized, Role: FOLLOWER
I20260808 09:57:57.821986 28255 consensus_queue.cc:260] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:57.822074 28256 consensus_queue.cc:260] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:57.822268 28255 ts_tablet_manager.cc:1428] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 09:57:57.822319 28256 ts_tablet_manager.cc:1428] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 09:57:57.822402 28213 heartbeater.cc:503] Master 127.24.71.254:43865 was elected leader, sending a full tablet report...
I20260808 09:57:57.822538 28260 tablet_bootstrap.cc:654] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:57.822821 28010 heartbeater.cc:503] Master 127.24.71.254:43865 was elected leader, sending a full tablet report...
I20260808 09:57:57.822858 28260 log.cc:824] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378: Log is configured to *not* fsync() on all Append() calls
I20260808 09:57:57.823624 28260 tablet_bootstrap.cc:492] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378: No bootstrap required, opened a new log
I20260808 09:57:57.823704 28260 ts_tablet_manager.cc:1397] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:57:57.825258 28260 raft_consensus.cc:348] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:57.825377 28260 raft_consensus.cc:374] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:57.825407 28260 raft_consensus.cc:729] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84ad11af230488887d604a8acabf378, State: Initialized, Role: FOLLOWER
I20260808 09:57:57.825515 28260 consensus_queue.cc:260] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:57.825733 28260 ts_tablet_manager.cc:1428] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 09:57:57.825796 27804 heartbeater.cc:503] Master 127.24.71.254:43865 was elected leader, sending a full tablet report...
W20260808 09:57:57.847525 28012 tablet.cc:2369] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 09:57:57.932613 27805 tablet.cc:2369] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 09:57:58.019811 28214 tablet.cc:2369] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 09:57:58.143155 28262 raft_consensus.cc:482] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:57:58.143301 28262 raft_consensus.cc:504] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.143782 28262 leader_election.cc:288] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84ad11af230488887d604a8acabf378 (127.24.71.193:43221), 24cc5e62e64348b3a275fb9832f0e8e0 (127.24.71.195:45457)
I20260808 09:57:58.146728 28252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.144175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:40371 (local address 127.24.71.195:45457)
0808 09:57:58.144229 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:58.144231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:58.144242 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:57:58.144275 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:58.144276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:58.144287 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:58.144369 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:58.144519 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.144996 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.145962 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.146332 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.146421 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.146429 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:58.146608 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 09:57:58.146648 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 09:57:58.146725 28253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.144093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:39867 (local address 127.24.71.193:43221)
0808 09:57:58.144146 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:58.144148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:58.144214 (+ 66us) server_negotiation.cc:407] Connection header received
0808 09:57:58.144332 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:58.144333 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:58.144343 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:58.144424 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:58.144583 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.145041 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.145956 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.146323 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.146416 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.146426 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:58.146598 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 09:57:58.146637 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 09:57:58.146773 28267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.143992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:43221 (local address 127.24.71.194:39867)
0808 09:57:58.144136 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:58.144151 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:58.144252 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:58.144428 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:58.144429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:58.144431 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:58.144501 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.144502 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.145138 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.145140 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.145856 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.145858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.146416 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.146417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.146515 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.146519 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:57:58.146590 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 09:57:58.146637 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":21,"thread_start_us":93,"threads_started":1}
I20260808 09:57:58.146778 28268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.144004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:45457 (local address 127.24.71.194:40371)
0808 09:57:58.144146 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:58.144157 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:58.144217 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:58.144374 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:58.144375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:58.144378 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:58.144437 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.144438 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.145090 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.145092 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.145847 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.145849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.146421 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.146422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.146521 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.146525 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:57:58.146588 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 09:57:58.146640 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":3,"thread_start_us":61,"threads_started":1}
I20260808 09:57:58.147166 28146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "853bedde1d034cb78c62d51098bc1ae2" candidate_uuid: "eb41ab96fd624529bc1bae2601fa2747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" is_pre_election: true
I20260808 09:57:58.147145 27737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "853bedde1d034cb78c62d51098bc1ae2" candidate_uuid: "eb41ab96fd624529bc1bae2601fa2747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ad11af230488887d604a8acabf378" is_pre_election: true
I20260808 09:57:58.147328 28146 raft_consensus.cc:2454] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb41ab96fd624529bc1bae2601fa2747 in term 0.
I20260808 09:57:58.147328 27737 raft_consensus.cc:2454] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb41ab96fd624529bc1bae2601fa2747 in term 0.
I20260808 09:57:58.147601 27841 leader_election.cc:302] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cc5e62e64348b3a275fb9832f0e8e0, eb41ab96fd624529bc1bae2601fa2747; no voters:
I20260808 09:57:58.147750 28262 raft_consensus.cc:2781] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:57:58.147815 28262 raft_consensus.cc:482] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:57:58.147840 28262 raft_consensus.cc:3037] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:58.148597 28262 raft_consensus.cc:504] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.148761 28262 leader_election.cc:288] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [CANDIDATE]: Term 1 election: Requested vote from peers c84ad11af230488887d604a8acabf378 (127.24.71.193:43221), 24cc5e62e64348b3a275fb9832f0e8e0 (127.24.71.195:45457)
I20260808 09:57:58.148972 28146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "853bedde1d034cb78c62d51098bc1ae2" candidate_uuid: "eb41ab96fd624529bc1bae2601fa2747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cc5e62e64348b3a275fb9832f0e8e0"
I20260808 09:57:58.148977 27737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "853bedde1d034cb78c62d51098bc1ae2" candidate_uuid: "eb41ab96fd624529bc1bae2601fa2747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ad11af230488887d604a8acabf378"
I20260808 09:57:58.149063 28146 raft_consensus.cc:3037] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:58.149063 27737 raft_consensus.cc:3037] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:58.149983 27737 raft_consensus.cc:2454] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb41ab96fd624529bc1bae2601fa2747 in term 1.
I20260808 09:57:58.149976 28146 raft_consensus.cc:2454] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb41ab96fd624529bc1bae2601fa2747 in term 1.
I20260808 09:57:58.150164 27841 leader_election.cc:302] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cc5e62e64348b3a275fb9832f0e8e0, eb41ab96fd624529bc1bae2601fa2747; no voters:
I20260808 09:57:58.150278 28262 raft_consensus.cc:2781] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:57:58.150399 28262 raft_consensus.cc:686] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [term 1 LEADER]: Becoming Leader. State: Replica: eb41ab96fd624529bc1bae2601fa2747, State: Running, Role: LEADER
I20260808 09:57:58.150518 28262 consensus_queue.cc:237] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.151434 27492 catalog_manager.cc:5495] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb41ab96fd624529bc1bae2601fa2747 (127.24.71.194). New cstate: current_term: 1 leader_uuid: "eb41ab96fd624529bc1bae2601fa2747" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } health_report { overall_health: UNKNOWN } } }
Aug 08 09:57:58 dist-test-slave-gw5c krb5kdc[27419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183077, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:57:58.195667 27563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.188254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43060 (local address 127.24.71.254:43865)
0808 09:57:58.188371 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:58.188374 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:58.188490 (+ 116us) server_negotiation.cc:407] Connection header received
0808 09:57:58.188593 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:58.188594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:58.188605 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:58.188682 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:57:58.189165 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.189663 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.190361 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.190553 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.190639 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.192765 (+ 2126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:57:58.192766 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:57:58.192767 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:57:58.192774 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:57:58.194231 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:58.194748 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:58.194749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:58.194750 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:58.194817 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:57:58.195022 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:57:58.195024 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:57:58.195024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:57:58.195154 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:57:58.195234 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:58.195416 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 09:57:58.195533 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 09:57:58.195740 28282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.188163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43865 (local address 127.0.0.1:43060)
0808 09:57:58.188381 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:58.188392 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:58.188514 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:58.188685 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:58.188687 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:58.189022 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:57:58.189071 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.189074 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.189749 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.189750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.190268 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.190270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.190640 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.190641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.190701 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.191229 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:57:58.191234 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:57:58.192670 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:57:58.194318 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:58.194326 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:58.194329 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:58.194675 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:58.194887 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:57:58.194887 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:57:58.194888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:57:58.194947 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:57:58.195225 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:57:58.195233 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:57:58.195282 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 09:57:58.195371 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 09:57:58.195599 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":97,"thread_start_us":135,"threads_started":1}
I20260808 09:57:58.197803 27492 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:43060:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 09:57:58.197996 27492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:57:58.199821 27706 tablet_service.cc:1467] Processing CreateTablet for tablet 9168be30ddac4ed297b2e86a9f68ae14 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7d742b25ec5744d9a87c0201b5f1e86b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 09:57:58.199842 28116 tablet_service.cc:1467] Processing CreateTablet for tablet 9168be30ddac4ed297b2e86a9f68ae14 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7d742b25ec5744d9a87c0201b5f1e86b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 09:57:58.199836 27907 tablet_service.cc:1467] Processing CreateTablet for tablet 9168be30ddac4ed297b2e86a9f68ae14 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7d742b25ec5744d9a87c0201b5f1e86b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 09:57:58.200012 27907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9168be30ddac4ed297b2e86a9f68ae14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:58.200012 28116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9168be30ddac4ed297b2e86a9f68ae14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:58.200012 27706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9168be30ddac4ed297b2e86a9f68ae14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:58.201448 28260 tablet_bootstrap.cc:492] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378: Bootstrap starting.
I20260808 09:57:58.201637 28255 tablet_bootstrap.cc:492] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0: Bootstrap starting.
I20260808 09:57:58.201893 28260 tablet_bootstrap.cc:654] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:58.202180 28255 tablet_bootstrap.cc:654] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:58.202270 28256 tablet_bootstrap.cc:492] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747: Bootstrap starting.
I20260808 09:57:58.202728 28256 tablet_bootstrap.cc:654] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:58.202936 28255 tablet_bootstrap.cc:492] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0: No bootstrap required, opened a new log
I20260808 09:57:58.203001 28255 ts_tablet_manager.cc:1397] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:57:58.203159 28255 raft_consensus.cc:348] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.203243 28255 raft_consensus.cc:374] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:58.203271 28255 raft_consensus.cc:729] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cc5e62e64348b3a275fb9832f0e8e0, State: Initialized, Role: FOLLOWER
I20260808 09:57:58.203305 28255 consensus_queue.cc:260] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.203415 28255 ts_tablet_manager.cc:1428] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 09:57:58.203558 28261 tablet_replica.cc:439] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } } }
I20260808 09:57:58.203644 28261 tablet_replica.cc:442] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:58.203846 28260 tablet_bootstrap.cc:492] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378: No bootstrap required, opened a new log
I20260808 09:57:58.203922 28260 ts_tablet_manager.cc:1397] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:57:58.204083 28260 raft_consensus.cc:348] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.204154 28260 raft_consensus.cc:374] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:58.204169 28260 raft_consensus.cc:729] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84ad11af230488887d604a8acabf378, State: Initialized, Role: FOLLOWER
I20260808 09:57:58.204222 28260 consensus_queue.cc:260] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.204327 28260 ts_tablet_manager.cc:1428] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:58.204377 28265 tablet_replica.cc:439] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } } }
I20260808 09:57:58.204481 28265 tablet_replica.cc:442] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:58.204672 28256 tablet_bootstrap.cc:492] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747: No bootstrap required, opened a new log
I20260808 09:57:58.204717 28256 ts_tablet_manager.cc:1397] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:57:58.204828 28256 raft_consensus.cc:348] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.204878 28256 raft_consensus.cc:374] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:58.204892 28256 raft_consensus.cc:729] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb41ab96fd624529bc1bae2601fa2747, State: Initialized, Role: FOLLOWER
I20260808 09:57:58.204949 28256 consensus_queue.cc:260] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.205050 28256 ts_tablet_manager.cc:1428] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:58.205117 28262 tablet_replica.cc:439] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } } }
I20260808 09:57:58.205210 28262 tablet_replica.cc:442] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:58.561929 28262 consensus_queue.cc:1035] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:57:58.564391 28288 consensus_queue.cc:1035] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:57:58.571118 28261 raft_consensus.cc:482] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:57:58.571220 28261 raft_consensus.cc:504] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.571593 28261 leader_election.cc:288] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84ad11af230488887d604a8acabf378 (127.24.71.193:43221), eb41ab96fd624529bc1bae2601fa2747 (127.24.71.194:39881)
I20260808 09:57:58.574550 28253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.571843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:50877 (local address 127.24.71.193:43221)
0808 09:57:58.571889 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:58.571891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:58.571978 (+ 87us) server_negotiation.cc:407] Connection header received
0808 09:57:58.572049 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:58.572050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:58.572060 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:58.572117 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:58.572272 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.572753 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.573832 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.574208 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.574287 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.574297 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:58.574442 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 09:57:58.574477 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 09:57:58.574587 28293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.571778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:43221 (local address 127.24.71.195:50877)
0808 09:57:58.571884 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:58.571897 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:58.571995 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:58.572121 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:58.572122 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:58.572123 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:58.572197 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.572199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.572835 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.572836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.573738 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.573740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.574287 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.574288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.574362 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.574367 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 09:57:58.574426 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 09:57:58.574467 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":79,"threads_started":1}
I20260808 09:57:58.574596 28295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.571924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:46577 (local address 127.24.71.194:39881)
0808 09:57:58.572084 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:58.572086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:58.572093 (+ 7us) server_negotiation.cc:407] Connection header received
0808 09:57:58.572122 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:58.572123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:58.572130 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:58.572208 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:57:58.572373 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.572854 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.573835 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.574231 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.574301 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.574309 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:58.574468 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 09:57:58.574508 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":102,"threads_started":1}
I20260808 09:57:58.574597 28294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.571778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:39881 (local address 127.24.71.195:46577)
0808 09:57:58.571909 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:58.571920 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:58.571974 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:58.572225 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:58.572225 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:58.572228 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:57:58.572301 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.572303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.572942 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.572943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.573730 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.573732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.574299 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.574300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.574375 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.574379 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:57:58.574455 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 09:57:58.574499 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":2,"thread_start_us":63,"threads_started":1}
I20260808 09:57:58.575016 27737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9168be30ddac4ed297b2e86a9f68ae14" candidate_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ad11af230488887d604a8acabf378" is_pre_election: true
I20260808 09:57:58.575112 27737 raft_consensus.cc:2454] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cc5e62e64348b3a275fb9832f0e8e0 in term 0.
I20260808 09:57:58.575153 27933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9168be30ddac4ed297b2e86a9f68ae14" candidate_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb41ab96fd624529bc1bae2601fa2747" is_pre_election: true
I20260808 09:57:58.575279 27933 raft_consensus.cc:2454] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cc5e62e64348b3a275fb9832f0e8e0 in term 0.
I20260808 09:57:58.575294 28046 leader_election.cc:302] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cc5e62e64348b3a275fb9832f0e8e0, c84ad11af230488887d604a8acabf378; no voters:
I20260808 09:57:58.575547 28261 raft_consensus.cc:2781] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:57:58.575605 28261 raft_consensus.cc:482] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:57:58.575634 28261 raft_consensus.cc:3037] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:58.576382 28261 raft_consensus.cc:504] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.576545 28261 leader_election.cc:288] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [CANDIDATE]: Term 1 election: Requested vote from peers c84ad11af230488887d604a8acabf378 (127.24.71.193:43221), eb41ab96fd624529bc1bae2601fa2747 (127.24.71.194:39881)
I20260808 09:57:58.576704 27933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9168be30ddac4ed297b2e86a9f68ae14" candidate_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb41ab96fd624529bc1bae2601fa2747"
I20260808 09:57:58.576704 27737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9168be30ddac4ed297b2e86a9f68ae14" candidate_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ad11af230488887d604a8acabf378"
I20260808 09:57:58.576782 27737 raft_consensus.cc:3037] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:58.576782 27933 raft_consensus.cc:3037] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:58.577595 27737 raft_consensus.cc:2454] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cc5e62e64348b3a275fb9832f0e8e0 in term 1.
I20260808 09:57:58.577595 27933 raft_consensus.cc:2454] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cc5e62e64348b3a275fb9832f0e8e0 in term 1.
I20260808 09:57:58.577783 28046 leader_election.cc:302] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cc5e62e64348b3a275fb9832f0e8e0, c84ad11af230488887d604a8acabf378; no voters:
I20260808 09:57:58.577895 28261 raft_consensus.cc:2781] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:57:58.578063 28261 raft_consensus.cc:686] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 LEADER]: Becoming Leader. State: Replica: 24cc5e62e64348b3a275fb9832f0e8e0, State: Running, Role: LEADER
I20260808 09:57:58.578164 28261 consensus_queue.cc:237] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.578547 28296 tablet_replica.cc:439] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0: TxnStatusTablet state changed. Reason: New leader 24cc5e62e64348b3a275fb9832f0e8e0. Latest consensus state: current_term: 1 leader_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } } }
I20260808 09:57:58.578665 28296 tablet_replica.cc:442] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0: This TxnStatusTablet replica's current role is: LEADER
I20260808 09:57:58.578857 28298 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 09:57:58.579006 28298 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 09:57:58.578991 27493 catalog_manager.cc:5495] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24cc5e62e64348b3a275fb9832f0e8e0 (127.24.71.195). New cstate: current_term: 1 leader_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } health_report { overall_health: HEALTHY } } }
I20260808 09:57:58.650444 28303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.647822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38184 (local address 127.24.71.195:45457)
0808 09:57:58.647953 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:58.647955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:58.647963 (+ 8us) server_negotiation.cc:407] Connection header received
0808 09:57:58.647995 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:58.647995 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:58.648020 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:58.648107 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:57:58.648251 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.648767 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.649534 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.649765 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.649845 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.650047 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:57:58.650155 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:57:58.650248 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:58.650301 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 09:57:58.650324 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":91,"threads_started":1}
I20260808 09:57:58.650424 28282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.647586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:45457 (local address 127.0.0.1:38184)
0808 09:57:58.647679 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:58.647692 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:58.647743 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:58.648116 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:58.648117 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:58.648119 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 09:57:58.648174 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.648177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.648857 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.648859 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.649448 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.649450 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.649843 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.649845 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.649913 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.649940 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 09:57:58.650227 (+ 287us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 09:57:58.650237 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 09:57:58.650295 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 09:57:58.650349 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 09:57:58.652896 27933 raft_consensus.cc:1261] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Refusing update from remote peer 24cc5e62e64348b3a275fb9832f0e8e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:57:58.652884 27737 raft_consensus.cc:1261] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Refusing update from remote peer 24cc5e62e64348b3a275fb9832f0e8e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:57:58.653177 28261 consensus_queue.cc:1035] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:57:58.653282 28296 consensus_queue.cc:1035] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:57:58.654481 28288 tablet_replica.cc:439] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747: TxnStatusTablet state changed. Reason: New leader 24cc5e62e64348b3a275fb9832f0e8e0. Latest consensus state: current_term: 1 leader_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } } }
I20260808 09:57:58.654575 28288 tablet_replica.cc:442] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:58.654510 28265 tablet_replica.cc:439] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378: TxnStatusTablet state changed. Reason: New leader 24cc5e62e64348b3a275fb9832f0e8e0. Latest consensus state: current_term: 1 leader_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } } }
I20260808 09:57:58.654604 28265 tablet_replica.cc:442] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:58.655357 28261 tablet_replica.cc:439] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } } }
I20260808 09:57:58.655483 28261 tablet_replica.cc:442] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0: This TxnStatusTablet replica's current role is: LEADER
I20260808 09:57:58.655670 28265 tablet_replica.cc:439] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } } }
I20260808 09:57:58.655757 28265 tablet_replica.cc:442] T 9168be30ddac4ed297b2e86a9f68ae14 P c84ad11af230488887d604a8acabf378: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:58.655812 28290 mvcc.cc:205] Tried to move back new op lower bound from 7316205890158559232 to 7316205889856753664. Current Snapshot: MvccSnapshot[applied={T|T < 7316205890158559232}]
I20260808 09:57:58.655900 28292 mvcc.cc:205] Tried to move back new op lower bound from 7316205890158559232 to 7316205889856753664. Current Snapshot: MvccSnapshot[applied={T|T < 7316205890158559232}]
I20260808 09:57:58.657173 28261 tablet_replica.cc:439] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } } }
I20260808 09:57:58.657260 28261 tablet_replica.cc:442] T 9168be30ddac4ed297b2e86a9f68ae14 P 24cc5e62e64348b3a275fb9832f0e8e0: This TxnStatusTablet replica's current role is: LEADER
I20260808 09:57:58.657994 28288 tablet_replica.cc:439] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } } }
I20260808 09:57:58.658084 28288 tablet_replica.cc:442] T 9168be30ddac4ed297b2e86a9f68ae14 P eb41ab96fd624529bc1bae2601fa2747: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:57:58.661098 28295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.657622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33848 (local address 127.24.71.194:39881)
0808 09:57:58.657664 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:58.657666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:58.658427 (+ 761us) server_negotiation.cc:407] Connection header received
0808 09:57:58.658531 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:58.658532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:58.658555 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:58.658606 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:57:58.658747 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.659209 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.660379 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.660568 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.660615 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.660806 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:57:58.660890 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:57:58.660949 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:58.661029 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 09:57:58.661048 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 09:57:58.666132 28303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.663771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:51603 (local address 127.24.71.195:45457)
0808 09:57:58.663807 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:58.663809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:58.663977 (+ 168us) server_negotiation.cc:407] Connection header received
0808 09:57:58.664043 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:58.664044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:58.664055 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:58.664121 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:57:58.664265 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.664710 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.665428 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.665622 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.665699 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.665887 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:57:58.665920 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:57:58.665983 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:58.666043 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 09:57:58.666064 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 09:57:58.666158 28316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.663693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:45457 (local address 127.24.71.194:51603)
0808 09:57:58.663891 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:58.663900 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:58.663993 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:58.664135 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:58.664136 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:58.664138 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 09:57:58.664185 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.664187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.664788 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.664789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.665344 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.665345 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.665697 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.665698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.665760 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.665781 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 09:57:58.665997 (+ 216us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 09:57:58.666000 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:57:58.666042 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 09:57:58.666084 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":82,"threads_started":1}
I20260808 09:57:58.677088 28295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.673996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:52599 (local address 127.24.71.194:39881)
0808 09:57:58.674040 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 09:57:58.674042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:57:58.674238 (+ 196us) server_negotiation.cc:407] Connection header received
0808 09:57:58.674332 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:57:58.674332 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:57:58.674343 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:57:58.674371 (+ 28us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:57:58.674560 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.675006 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.676255 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.676591 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.676644 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.676888 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:57:58.676915 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:57:58.676959 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 09:57:58.677015 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 09:57:58.677034 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 09:57:58.677168 28319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:57:58.673940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:39881 (local address 127.24.71.195:52599)
0808 09:57:58.674179 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 09:57:58.674191 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:57:58.674262 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:57:58.674430 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:57:58.674431 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:57:58.674432 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 09:57:58.674489 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.674490 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.675100 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.675101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.676156 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:57:58.676158 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:57:58.676734 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:57:58.676735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:57:58.676797 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:57:58.676810 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 09:57:58.676963 (+ 153us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 09:57:58.676964 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 09:57:58.677013 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 09:57:58.677059 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":87,"threads_started":1}
I20260808 09:57:58.686527 27492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:57:58.686661 27492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:57:58.687477 27492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2: Sending DeleteTablet for 3 replicas of tablet 853bedde1d034cb78c62d51098bc1ae2
I20260808 09:57:58.687831 27907 tablet_service.cc:1514] Processing DeleteTablet for tablet 853bedde1d034cb78c62d51098bc1ae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:57:58 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:33842
I20260808 09:57:58.688174 28116 tablet_service.cc:1514] Processing DeleteTablet for tablet 853bedde1d034cb78c62d51098bc1ae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:57:58 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:38178
I20260808 09:57:58.688386 27706 tablet_service.cc:1514] Processing DeleteTablet for tablet 853bedde1d034cb78c62d51098bc1ae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:57:58 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:55200
I20260808 09:57:58.688443 27492 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43056:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:57:58.688603 27492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:57:58.688840 28325 tablet_replica.cc:330] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0: stopping tablet replica
I20260808 09:57:58.688992 28326 tablet_replica.cc:330] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378: stopping tablet replica
I20260808 09:57:58.689155 28326 raft_consensus.cc:2229] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:57:58.689303 28325 raft_consensus.cc:2229] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:57:58.689420 28326 raft_consensus.cc:2258] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:57:58.689545 28325 raft_consensus.cc:2258] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:57:58.689895 27907 tablet_service.cc:1467] Processing CreateTablet for tablet 1c15952a74d1403491cc1a1052fbd0e5 (DEFAULT_TABLE table=test-table [id=4169d9e10bc74b4a8ff5e6f109aefe4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:58.690043 27907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c15952a74d1403491cc1a1052fbd0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:58.690367 28326 ts_tablet_manager.cc:1905] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:57:58.690598 28325 ts_tablet_manager.cc:1905] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:57:58.691550 28256 tablet_bootstrap.cc:492] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747: Bootstrap starting.
I20260808 09:57:58.692016 28256 tablet_bootstrap.cc:654] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:58.692654 28116 tablet_service.cc:1467] Processing CreateTablet for tablet 1c15952a74d1403491cc1a1052fbd0e5 (DEFAULT_TABLE table=test-table [id=4169d9e10bc74b4a8ff5e6f109aefe4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:58.692888 27706 tablet_service.cc:1467] Processing CreateTablet for tablet 1c15952a74d1403491cc1a1052fbd0e5 (DEFAULT_TABLE table=test-table [id=4169d9e10bc74b4a8ff5e6f109aefe4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:57:58.692924 28116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c15952a74d1403491cc1a1052fbd0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:58.693006 27706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c15952a74d1403491cc1a1052fbd0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:57:58.694216 28255 tablet_bootstrap.cc:492] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0: Bootstrap starting.
I20260808 09:57:58.694639 28255 tablet_bootstrap.cc:654] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:58.694851 28256 tablet_bootstrap.cc:492] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747: No bootstrap required, opened a new log
I20260808 09:57:58.694901 28256 ts_tablet_manager.cc:1397] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 09:57:58.695044 28256 raft_consensus.cc:348] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.695127 28256 raft_consensus.cc:374] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:58.695154 28256 raft_consensus.cc:729] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb41ab96fd624529bc1bae2601fa2747, State: Initialized, Role: FOLLOWER
I20260808 09:57:58.695211 28256 consensus_queue.cc:260] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.695333 28256 ts_tablet_manager.cc:1428] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:58.696118 28326 ts_tablet_manager.cc:1918] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:57:58.696825 28325 ts_tablet_manager.cc:1918] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:57:58.696956 28325 log.cc:1196] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/853bedde1d034cb78c62d51098bc1ae2
I20260808 09:57:58.696380 28260 tablet_bootstrap.cc:492] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378: Bootstrap starting.
I20260808 09:57:58.697190 28323 tablet_replica.cc:330] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747: stopping tablet replica
I20260808 09:57:58.697299 28323 raft_consensus.cc:2229] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [term 1 LEADER]: Raft consensus shutting down.
I20260808 09:57:58.697394 28323 raft_consensus.cc:2258] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:57:58.697443 28260 tablet_bootstrap.cc:654] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378: Neither blocks nor log segments found. Creating new log.
I20260808 09:57:58.697816 28323 ts_tablet_manager.cc:1905] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:57:58.698154 28325 ts_tablet_manager.cc:1939] T 853bedde1d034cb78c62d51098bc1ae2 P 24cc5e62e64348b3a275fb9832f0e8e0: Deleting consensus metadata
I20260808 09:57:58.697857 28326 log.cc:1196] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/wal/wals/853bedde1d034cb78c62d51098bc1ae2
I20260808 09:57:58.698588 28326 ts_tablet_manager.cc:1939] T 853bedde1d034cb78c62d51098bc1ae2 P c84ad11af230488887d604a8acabf378: Deleting consensus metadata
I20260808 09:57:58.698717 28255 tablet_bootstrap.cc:492] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0: No bootstrap required, opened a new log
I20260808 09:57:58.698770 28255 ts_tablet_manager.cc:1397] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 09:57:58.698930 28255 raft_consensus.cc:348] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.699039 28255 raft_consensus.cc:374] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:58.699069 28255 raft_consensus.cc:729] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cc5e62e64348b3a275fb9832f0e8e0, State: Initialized, Role: FOLLOWER
I20260808 09:57:58.699115 28255 consensus_queue.cc:260] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.699222 28255 ts_tablet_manager.cc:1428] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 09:57:58.699945 28323 ts_tablet_manager.cc:1918] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:57:58.700024 28323 log.cc:1196] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/853bedde1d034cb78c62d51098bc1ae2
I20260808 09:57:58.700296 28323 ts_tablet_manager.cc:1939] T 853bedde1d034cb78c62d51098bc1ae2 P eb41ab96fd624529bc1bae2601fa2747: Deleting consensus metadata
I20260808 09:57:58.700342 27473 catalog_manager.cc:4841] TS 24cc5e62e64348b3a275fb9832f0e8e0 (127.24.71.195:45457): tablet 853bedde1d034cb78c62d51098bc1ae2 (table test-table [id=136c9e68e9ec4d96816d673bc8b502d6]) successfully deleted
I20260808 09:57:58.700747 27470 catalog_manager.cc:4841] TS eb41ab96fd624529bc1bae2601fa2747 (127.24.71.194:39881): tablet 853bedde1d034cb78c62d51098bc1ae2 (table test-table [id=136c9e68e9ec4d96816d673bc8b502d6]) successfully deleted
I20260808 09:57:58.700788 27471 catalog_manager.cc:4841] TS c84ad11af230488887d604a8acabf378 (127.24.71.193:43221): tablet 853bedde1d034cb78c62d51098bc1ae2 (table test-table [id=136c9e68e9ec4d96816d673bc8b502d6]) successfully deleted
I20260808 09:57:58.701258 28260 tablet_bootstrap.cc:492] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378: No bootstrap required, opened a new log
I20260808 09:57:58.701308 28260 ts_tablet_manager.cc:1397] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 09:57:58.701471 28260 raft_consensus.cc:348] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.701550 28260 raft_consensus.cc:374] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:57:58.701570 28260 raft_consensus.cc:729] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84ad11af230488887d604a8acabf378, State: Initialized, Role: FOLLOWER
I20260808 09:57:58.701604 28260 consensus_queue.cc:260] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.701701 28260 ts_tablet_manager.cc:1428] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:57:58.831101 28288 raft_consensus.cc:482] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:57:58.831246 28288 raft_consensus.cc:504] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.831493 28288 leader_election.cc:288] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84ad11af230488887d604a8acabf378 (127.24.71.193:43221), 24cc5e62e64348b3a275fb9832f0e8e0 (127.24.71.195:45457)
I20260808 09:57:58.831791 28146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c15952a74d1403491cc1a1052fbd0e5" candidate_uuid: "eb41ab96fd624529bc1bae2601fa2747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" is_pre_election: true
I20260808 09:57:58.831849 27737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c15952a74d1403491cc1a1052fbd0e5" candidate_uuid: "eb41ab96fd624529bc1bae2601fa2747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ad11af230488887d604a8acabf378" is_pre_election: true
I20260808 09:57:58.831928 28146 raft_consensus.cc:2454] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb41ab96fd624529bc1bae2601fa2747 in term 0.
I20260808 09:57:58.831991 27737 raft_consensus.cc:2454] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb41ab96fd624529bc1bae2601fa2747 in term 0.
I20260808 09:57:58.832199 27840 leader_election.cc:302] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84ad11af230488887d604a8acabf378, eb41ab96fd624529bc1bae2601fa2747; no voters:
I20260808 09:57:58.832316 28288 raft_consensus.cc:2781] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:57:58.832381 28288 raft_consensus.cc:482] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:57:58.832397 28288 raft_consensus.cc:3037] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:58.833217 28288 raft_consensus.cc:504] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.833367 28288 leader_election.cc:288] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [CANDIDATE]: Term 1 election: Requested vote from peers c84ad11af230488887d604a8acabf378 (127.24.71.193:43221), 24cc5e62e64348b3a275fb9832f0e8e0 (127.24.71.195:45457)
I20260808 09:57:58.833506 27737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c15952a74d1403491cc1a1052fbd0e5" candidate_uuid: "eb41ab96fd624529bc1bae2601fa2747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ad11af230488887d604a8acabf378"
I20260808 09:57:58.833559 28146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c15952a74d1403491cc1a1052fbd0e5" candidate_uuid: "eb41ab96fd624529bc1bae2601fa2747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cc5e62e64348b3a275fb9832f0e8e0"
I20260808 09:57:58.833603 27737 raft_consensus.cc:3037] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:58.833643 28146 raft_consensus.cc:3037] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:57:58.834275 27737 raft_consensus.cc:2454] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb41ab96fd624529bc1bae2601fa2747 in term 1.
I20260808 09:57:58.834306 28146 raft_consensus.cc:2454] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb41ab96fd624529bc1bae2601fa2747 in term 1.
I20260808 09:57:58.834475 27840 leader_election.cc:302] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84ad11af230488887d604a8acabf378, eb41ab96fd624529bc1bae2601fa2747; no voters:
I20260808 09:57:58.834592 28288 raft_consensus.cc:2781] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:57:58.834671 28288 raft_consensus.cc:686] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [term 1 LEADER]: Becoming Leader. State: Replica: eb41ab96fd624529bc1bae2601fa2747, State: Running, Role: LEADER
I20260808 09:57:58.834726 28288 consensus_queue.cc:237] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:57:58.835434 27492 catalog_manager.cc:5495] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb41ab96fd624529bc1bae2601fa2747 (127.24.71.194). New cstate: current_term: 1 leader_uuid: "eb41ab96fd624529bc1bae2601fa2747" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } health_report { overall_health: UNKNOWN } } }
I20260808 09:57:58.845803 28146 raft_consensus.cc:1261] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Refusing update from remote peer eb41ab96fd624529bc1bae2601fa2747: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:57:58.845816 27737 raft_consensus.cc:1261] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Refusing update from remote peer eb41ab96fd624529bc1bae2601fa2747: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:57:58.846052 28269 consensus_queue.cc:1035] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:57:58.846151 28288 consensus_queue.cc:1035] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 09:57:58.850772 28287 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 09:58:00.368664 27493 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:00.368801 27493 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:00.369872 27493 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2: Sending DeleteTablet for 3 replicas of tablet 1c15952a74d1403491cc1a1052fbd0e5
I20260808 09:58:00.370177 27706 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c15952a74d1403491cc1a1052fbd0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:00 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:55200
I20260808 09:58:00.370203 27907 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c15952a74d1403491cc1a1052fbd0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:00 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:33842
I20260808 09:58:00.370371 28116 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c15952a74d1403491cc1a1052fbd0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:00 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:38178
I20260808 09:58:00.370445 28376 tablet_replica.cc:330] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747: stopping tablet replica
I20260808 09:58:00.370512 28376 raft_consensus.cc:2229] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [term 1 LEADER]: Raft consensus shutting down.
I20260808 09:58:00.370581 28376 raft_consensus.cc:2258] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:00.370627 28381 tablet_replica.cc:330] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0: stopping tablet replica
I20260808 09:58:00.370875 28381 raft_consensus.cc:2229] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:00.370879 28376 ts_tablet_manager.cc:1905] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:00.370981 28381 raft_consensus.cc:2258] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:00.370952 28374 tablet_replica.cc:330] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378: stopping tablet replica
I20260808 09:58:00.371043 28374 raft_consensus.cc:2229] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:00.371116 28374 raft_consensus.cc:2258] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:00.371407 28374 ts_tablet_manager.cc:1905] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:00.371536 28381 ts_tablet_manager.cc:1905] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:00.372884 28376 ts_tablet_manager.cc:1918] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 09:58:00.372987 28376 log.cc:1196] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/1c15952a74d1403491cc1a1052fbd0e5
I20260808 09:58:00.373263 28376 ts_tablet_manager.cc:1939] T 1c15952a74d1403491cc1a1052fbd0e5 P eb41ab96fd624529bc1bae2601fa2747: Deleting consensus metadata
I20260808 09:58:00.373589 27470 catalog_manager.cc:4841] TS eb41ab96fd624529bc1bae2601fa2747 (127.24.71.194:39881): tablet 1c15952a74d1403491cc1a1052fbd0e5 (table test-table [id=4169d9e10bc74b4a8ff5e6f109aefe4a]) successfully deleted
I20260808 09:58:00.373848 28381 ts_tablet_manager.cc:1918] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 09:58:00.373890 28374 ts_tablet_manager.cc:1918] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 09:58:00.373932 28381 log.cc:1196] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/1c15952a74d1403491cc1a1052fbd0e5
I20260808 09:58:00.373935 28374 log.cc:1196] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/wal/wals/1c15952a74d1403491cc1a1052fbd0e5
I20260808 09:58:00.374167 28381 ts_tablet_manager.cc:1939] T 1c15952a74d1403491cc1a1052fbd0e5 P 24cc5e62e64348b3a275fb9832f0e8e0: Deleting consensus metadata
I20260808 09:58:00.374208 28374 ts_tablet_manager.cc:1939] T 1c15952a74d1403491cc1a1052fbd0e5 P c84ad11af230488887d604a8acabf378: Deleting consensus metadata
I20260808 09:58:00.374536 27471 catalog_manager.cc:4841] TS c84ad11af230488887d604a8acabf378 (127.24.71.193:43221): tablet 1c15952a74d1403491cc1a1052fbd0e5 (table test-table [id=4169d9e10bc74b4a8ff5e6f109aefe4a]) successfully deleted
I20260808 09:58:00.374553 27473 catalog_manager.cc:4841] TS 24cc5e62e64348b3a275fb9832f0e8e0 (127.24.71.195:45457): tablet 1c15952a74d1403491cc1a1052fbd0e5 (table test-table [id=4169d9e10bc74b4a8ff5e6f109aefe4a]) successfully deleted
Aug 08 09:58:00 dist-test-slave-gw5c krb5kdc[27419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183080, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 09:58:00 dist-test-slave-gw5c krb5kdc[27419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183080, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:00.401302 28393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:00.389737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43070 (local address 127.24.71.254:43865)
0808 09:58:00.389932 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:00.389934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:00.389944 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:00.390007 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:00.390008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:00.390018 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:00.390082 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:00.390654 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.391173 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.391940 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.392140 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.392203 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:00.398558 (+ 6355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:00.398560 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:00.398560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:00.398567 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:00.400221 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:00.400542 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:00.400543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:00.400543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:00.400598 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:00.400851 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:00.400852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:00.400852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:00.400983 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:00.401106 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:00.401158 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 09:58:00.401228 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":77,"threads_started":1}
I20260808 09:58:00.402837 27493 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43070:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:58:00.403020 27493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:58:00.404513 27706 tablet_service.cc:1467] Processing CreateTablet for tablet 6ab4d09493104467af3ae809c6863d57 (DEFAULT_TABLE table=test-table [id=2ffe4e97adcb493ab0755422ad8dd6fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:00.404548 27907 tablet_service.cc:1467] Processing CreateTablet for tablet 6ab4d09493104467af3ae809c6863d57 (DEFAULT_TABLE table=test-table [id=2ffe4e97adcb493ab0755422ad8dd6fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:00.404582 28116 tablet_service.cc:1467] Processing CreateTablet for tablet 6ab4d09493104467af3ae809c6863d57 (DEFAULT_TABLE table=test-table [id=2ffe4e97adcb493ab0755422ad8dd6fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:00.404670 27706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ab4d09493104467af3ae809c6863d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:00.404690 27907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ab4d09493104467af3ae809c6863d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:00.404698 28116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ab4d09493104467af3ae809c6863d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:00.405771 28396 tablet_bootstrap.cc:492] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747: Bootstrap starting.
I20260808 09:58:00.406270 28396 tablet_bootstrap.cc:654] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:00.406298 28398 tablet_bootstrap.cc:492] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0: Bootstrap starting.
I20260808 09:58:00.406342 28397 tablet_bootstrap.cc:492] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378: Bootstrap starting.
I20260808 09:58:00.406687 28398 tablet_bootstrap.cc:654] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:00.406769 28397 tablet_bootstrap.cc:654] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:00.406963 28396 tablet_bootstrap.cc:492] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747: No bootstrap required, opened a new log
I20260808 09:58:00.407043 28396 ts_tablet_manager.cc:1397] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:00.407195 28396 raft_consensus.cc:348] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.407290 28396 raft_consensus.cc:374] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:00.407320 28396 raft_consensus.cc:729] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb41ab96fd624529bc1bae2601fa2747, State: Initialized, Role: FOLLOWER
I20260808 09:58:00.407378 28396 consensus_queue.cc:260] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.407523 28396 ts_tablet_manager.cc:1428] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 09:58:00.407528 28398 tablet_bootstrap.cc:492] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0: No bootstrap required, opened a new log
I20260808 09:58:00.407573 28398 ts_tablet_manager.cc:1397] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:00.407687 28398 raft_consensus.cc:348] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.407771 28398 raft_consensus.cc:374] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:00.407790 28398 raft_consensus.cc:729] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cc5e62e64348b3a275fb9832f0e8e0, State: Initialized, Role: FOLLOWER
I20260808 09:58:00.407840 28398 consensus_queue.cc:260] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.407935 28398 ts_tablet_manager.cc:1428] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:00.408188 28397 tablet_bootstrap.cc:492] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378: No bootstrap required, opened a new log
I20260808 09:58:00.408245 28397 ts_tablet_manager.cc:1397] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:58:00.408601 28397 raft_consensus.cc:348] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.408692 28397 raft_consensus.cc:374] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:00.408715 28397 raft_consensus.cc:729] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84ad11af230488887d604a8acabf378, State: Initialized, Role: FOLLOWER
I20260808 09:58:00.408762 28397 consensus_queue.cc:260] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.408929 28397 ts_tablet_manager.cc:1428] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:00.596264 28404 raft_consensus.cc:482] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:00.596372 28404 raft_consensus.cc:504] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.596800 28404 leader_election.cc:288] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb41ab96fd624529bc1bae2601fa2747 (127.24.71.194:39881), 24cc5e62e64348b3a275fb9832f0e8e0 (127.24.71.195:45457)
I20260808 09:58:00.600876 28407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:00.597115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:50687 (local address 127.24.71.195:45457)
0808 09:58:00.597321 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:00.597323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:00.597395 (+ 72us) server_negotiation.cc:407] Connection header received
0808 09:58:00.597514 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:00.597515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:00.597529 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:00.597605 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:00.597806 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.598396 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.600046 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.600492 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.600586 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:00.600595 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:00.600749 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 09:58:00.600794 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":88,"threads_started":1}
I20260808 09:58:00.600939 28405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:00.597028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:45457 (local address 127.24.71.193:50687)
0808 09:58:00.597282 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:00.597294 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:00.597384 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:00.597621 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:00.597622 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:00.597626 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:00.597715 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:00.597718 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.598493 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.598494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:00.599942 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:00.599945 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.600582 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.600583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:00.600665 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:00.600669 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:58:00.600741 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 09:58:00.600784 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":141,"thread_start_us":75,"threads_started":1}
I20260808 09:58:00.600955 28406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:00.597028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:39881 (local address 127.24.71.193:34761)
0808 09:58:00.597248 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:00.597260 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:00.597324 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:00.597675 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:00.597677 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:00.597680 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:00.597795 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:00.597797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.598789 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.598790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:00.599951 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:00.599952 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.600648 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.600650 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:00.600721 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:00.600723 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 09:58:00.600793 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 09:58:00.600834 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":6,"thread_start_us":132,"threads_started":1}
I20260808 09:58:00.600912 28408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:00.597379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:34761 (local address 127.24.71.194:39881)
0808 09:58:00.597544 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:00.597547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:00.597556 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:00.597581 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:00.597582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:00.597593 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:00.597657 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:00.597863 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.598685 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.600067 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.600543 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.600631 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:00.600643 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:00.600798 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 09:58:00.600840 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":94,"threads_started":1}
I20260808 09:58:00.601223 28146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ab4d09493104467af3ae809c6863d57" candidate_uuid: "c84ad11af230488887d604a8acabf378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" is_pre_election: true
I20260808 09:58:00.601356 28146 raft_consensus.cc:2454] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c84ad11af230488887d604a8acabf378 in term 0.
I20260808 09:58:00.601374 27933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ab4d09493104467af3ae809c6863d57" candidate_uuid: "c84ad11af230488887d604a8acabf378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb41ab96fd624529bc1bae2601fa2747" is_pre_election: true
I20260808 09:58:00.601480 27933 raft_consensus.cc:2454] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c84ad11af230488887d604a8acabf378 in term 0.
I20260808 09:58:00.601544 27633 leader_election.cc:302] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cc5e62e64348b3a275fb9832f0e8e0, c84ad11af230488887d604a8acabf378; no voters:
I20260808 09:58:00.601678 28404 raft_consensus.cc:2781] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:58:00.601717 28404 raft_consensus.cc:482] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:58:00.601751 28404 raft_consensus.cc:3037] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:00.602535 28404 raft_consensus.cc:504] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.602692 28404 leader_election.cc:288] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [CANDIDATE]: Term 1 election: Requested vote from peers eb41ab96fd624529bc1bae2601fa2747 (127.24.71.194:39881), 24cc5e62e64348b3a275fb9832f0e8e0 (127.24.71.195:45457)
I20260808 09:58:00.602846 27933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ab4d09493104467af3ae809c6863d57" candidate_uuid: "c84ad11af230488887d604a8acabf378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb41ab96fd624529bc1bae2601fa2747"
I20260808 09:58:00.602854 28146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ab4d09493104467af3ae809c6863d57" candidate_uuid: "c84ad11af230488887d604a8acabf378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cc5e62e64348b3a275fb9832f0e8e0"
I20260808 09:58:00.602926 28146 raft_consensus.cc:3037] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:00.602924 27933 raft_consensus.cc:3037] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:00.603717 28146 raft_consensus.cc:2454] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84ad11af230488887d604a8acabf378 in term 1.
I20260808 09:58:00.603717 27933 raft_consensus.cc:2454] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84ad11af230488887d604a8acabf378 in term 1.
I20260808 09:58:00.603871 27633 leader_election.cc:302] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cc5e62e64348b3a275fb9832f0e8e0, c84ad11af230488887d604a8acabf378; no voters:
I20260808 09:58:00.603981 28404 raft_consensus.cc:2781] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:00.604126 28404 raft_consensus.cc:686] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [term 1 LEADER]: Becoming Leader. State: Replica: c84ad11af230488887d604a8acabf378, State: Running, Role: LEADER
I20260808 09:58:00.604184 28404 consensus_queue.cc:237] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.605005 27493 catalog_manager.cc:5495] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 reported cstate change: term changed from 0 to 1, leader changed from <none> to c84ad11af230488887d604a8acabf378 (127.24.71.193). New cstate: current_term: 1 leader_uuid: "c84ad11af230488887d604a8acabf378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } health_report { overall_health: UNKNOWN } } }
I20260808 09:58:00.639792 28416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:00.636849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55206 (local address 127.24.71.193:43221)
0808 09:58:00.637049 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:00.637051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:00.637061 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:00.637106 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:00.637107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:00.637128 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:00.637234 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:00.637425 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.638067 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.638853 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.639091 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.639170 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:00.639358 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:00.639513 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:00.639608 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:00.639650 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 09:58:00.639671 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":116,"threads_started":1}
I20260808 09:58:00.645334 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:00.642207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:45457 (local address 127.24.71.193:40057)
0808 09:58:00.642393 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:00.642407 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:00.642479 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:00.642675 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:00.642676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:00.642678 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 09:58:00.642772 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:00.642774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.643610 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.643611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:00.644308 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:00.644311 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.644760 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.644761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:00.644841 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:00.644865 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 09:58:00.645102 (+ 237us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 09:58:00.645106 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:58:00.645178 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 09:58:00.645230 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":61,"threads_started":1}
I20260808 09:58:00.645315 28407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:00.642396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:40057 (local address 127.24.71.195:45457)
0808 09:58:00.642455 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:00.642457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:00.642477 (+ 20us) server_negotiation.cc:407] Connection header received
0808 09:58:00.642566 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:00.642567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:00.642587 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:00.642657 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:00.642863 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.643504 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.644432 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.644661 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.644758 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:00.644979 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:00.645026 (+ 47us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:00.645102 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:00.645184 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 09:58:00.645211 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 09:58:00.648032 28146 raft_consensus.cc:1261] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Refusing update from remote peer c84ad11af230488887d604a8acabf378: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:00.648053 27933 raft_consensus.cc:1261] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Refusing update from remote peer c84ad11af230488887d604a8acabf378: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:00.648298 28404 consensus_queue.cc:1035] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:00.648475 28410 consensus_queue.cc:1035] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:00.656064 28416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:00.653594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:48847 (local address 127.24.71.193:43221)
0808 09:58:00.653694 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:00.653697 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:00.653773 (+ 76us) server_negotiation.cc:407] Connection header received
0808 09:58:00.653829 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:00.653831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:00.653845 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:00.653924 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:00.654056 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.654520 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.655251 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.655554 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.655617 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:00.655803 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:00.655843 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:00.655906 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:00.655969 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 09:58:00.655991 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 09:58:00.656087 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:00.653554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:43221 (local address 127.24.71.195:48847)
0808 09:58:00.653708 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:00.653719 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:00.653776 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:00.653928 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:00.653929 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:00.653932 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 09:58:00.653978 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:00.653979 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.654601 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.654602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:00.655165 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:00.655167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:00.655655 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:00.655656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:00.655716 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:00.655720 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 09:58:00.655907 (+ 187us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 09:58:00.655910 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:00.655955 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 09:58:00.656008 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":102,"threads_started":1}
I20260808 09:58:00.662824 27492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:00.662945 27492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:00.663611 27492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2: Sending DeleteTablet for 3 replicas of tablet 6ab4d09493104467af3ae809c6863d57
I20260808 09:58:00.663869 27706 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ab4d09493104467af3ae809c6863d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:00 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:55200
I20260808 09:58:00.663887 28116 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ab4d09493104467af3ae809c6863d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:00 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:38178
I20260808 09:58:00.663964 28374 tablet_replica.cc:330] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378: stopping tablet replica
I20260808 09:58:00.664016 28374 raft_consensus.cc:2229] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [term 1 LEADER]: Raft consensus shutting down.
I20260808 09:58:00.664034 28381 tablet_replica.cc:330] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0: stopping tablet replica
I20260808 09:58:00.664034 27907 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ab4d09493104467af3ae809c6863d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:00 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:33842
I20260808 09:58:00.664093 28374 raft_consensus.cc:2258] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:00.664094 28381 raft_consensus.cc:2229] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:00.664135 28381 raft_consensus.cc:2258] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:00.664177 28376 tablet_replica.cc:330] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747: stopping tablet replica
I20260808 09:58:00.664232 28376 raft_consensus.cc:2229] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:00.664269 28376 raft_consensus.cc:2258] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:00.664547 28381 ts_tablet_manager.cc:1905] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:00.664770 28376 ts_tablet_manager.cc:1905] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:00.666232 28381 ts_tablet_manager.cc:1918] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:58:00.666271 28376 ts_tablet_manager.cc:1918] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:58:00.666288 28381 log.cc:1196] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/6ab4d09493104467af3ae809c6863d57
I20260808 09:58:00.666318 28376 log.cc:1196] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/6ab4d09493104467af3ae809c6863d57
I20260808 09:58:00.666518 28381 ts_tablet_manager.cc:1939] T 6ab4d09493104467af3ae809c6863d57 P 24cc5e62e64348b3a275fb9832f0e8e0: Deleting consensus metadata
I20260808 09:58:00.666538 28376 ts_tablet_manager.cc:1939] T 6ab4d09493104467af3ae809c6863d57 P eb41ab96fd624529bc1bae2601fa2747: Deleting consensus metadata
I20260808 09:58:00.666769 28374 ts_tablet_manager.cc:1905] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:00.666952 27473 catalog_manager.cc:4841] TS 24cc5e62e64348b3a275fb9832f0e8e0 (127.24.71.195:45457): tablet 6ab4d09493104467af3ae809c6863d57 (table test-table [id=2ffe4e97adcb493ab0755422ad8dd6fb]) successfully deleted
I20260808 09:58:00.667032 27470 catalog_manager.cc:4841] TS eb41ab96fd624529bc1bae2601fa2747 (127.24.71.194:39881): tablet 6ab4d09493104467af3ae809c6863d57 (table test-table [id=2ffe4e97adcb493ab0755422ad8dd6fb]) successfully deleted
I20260808 09:58:00.668151 28374 ts_tablet_manager.cc:1918] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:58:00.668208 28374 log.cc:1196] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786183068256695-24863-0/minicluster-data/ts-0/wal/wals/6ab4d09493104467af3ae809c6863d57
I20260808 09:58:00.668430 28374 ts_tablet_manager.cc:1939] T 6ab4d09493104467af3ae809c6863d57 P c84ad11af230488887d604a8acabf378: Deleting consensus metadata
I20260808 09:58:00.668509 27492 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43070:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:58:00.668682 27492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:58:00.668967 27471 catalog_manager.cc:4841] TS c84ad11af230488887d604a8acabf378 (127.24.71.193:43221): tablet 6ab4d09493104467af3ae809c6863d57 (table test-table [id=2ffe4e97adcb493ab0755422ad8dd6fb]) successfully deleted
I20260808 09:58:00.669962 27706 tablet_service.cc:1467] Processing CreateTablet for tablet 6462aeeb5231495abf8d2ccd9e4cb66e (DEFAULT_TABLE table=test-table [id=11ecc52b596b4d5782823b83ad7fd4cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:00.669960 28116 tablet_service.cc:1467] Processing CreateTablet for tablet 6462aeeb5231495abf8d2ccd9e4cb66e (DEFAULT_TABLE table=test-table [id=11ecc52b596b4d5782823b83ad7fd4cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:00.670002 27907 tablet_service.cc:1467] Processing CreateTablet for tablet 6462aeeb5231495abf8d2ccd9e4cb66e (DEFAULT_TABLE table=test-table [id=11ecc52b596b4d5782823b83ad7fd4cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:00.670075 27706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6462aeeb5231495abf8d2ccd9e4cb66e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:00.670075 28116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6462aeeb5231495abf8d2ccd9e4cb66e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:00.670123 27907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6462aeeb5231495abf8d2ccd9e4cb66e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:00.671305 28397 tablet_bootstrap.cc:492] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378: Bootstrap starting.
I20260808 09:58:00.671350 28398 tablet_bootstrap.cc:492] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0: Bootstrap starting.
I20260808 09:58:00.671440 28396 tablet_bootstrap.cc:492] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747: Bootstrap starting.
I20260808 09:58:00.671710 28398 tablet_bootstrap.cc:654] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:00.671742 28396 tablet_bootstrap.cc:654] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:00.671772 28397 tablet_bootstrap.cc:654] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:00.672341 28398 tablet_bootstrap.cc:492] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0: No bootstrap required, opened a new log
I20260808 09:58:00.672396 28398 ts_tablet_manager.cc:1397] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 09:58:00.672502 28398 raft_consensus.cc:348] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.672556 28396 tablet_bootstrap.cc:492] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747: No bootstrap required, opened a new log
I20260808 09:58:00.672581 28398 raft_consensus.cc:374] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:00.672605 28398 raft_consensus.cc:729] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cc5e62e64348b3a275fb9832f0e8e0, State: Initialized, Role: FOLLOWER
I20260808 09:58:00.672609 28396 ts_tablet_manager.cc:1397] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:00.672650 28398 consensus_queue.cc:260] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.672744 28398 ts_tablet_manager.cc:1428] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:00.672714 28396 raft_consensus.cc:348] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.672787 28396 raft_consensus.cc:374] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:00.672807 28396 raft_consensus.cc:729] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb41ab96fd624529bc1bae2601fa2747, State: Initialized, Role: FOLLOWER
I20260808 09:58:00.672849 28396 consensus_queue.cc:260] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.672966 28396 ts_tablet_manager.cc:1428] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 09:58:00.673818 28397 tablet_bootstrap.cc:492] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378: No bootstrap required, opened a new log
I20260808 09:58:00.673894 28397 ts_tablet_manager.cc:1397] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 09:58:00.674054 28397 raft_consensus.cc:348] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.674134 28397 raft_consensus.cc:374] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:00.674162 28397 raft_consensus.cc:729] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84ad11af230488887d604a8acabf378, State: Initialized, Role: FOLLOWER
I20260808 09:58:00.674222 28397 consensus_queue.cc:260] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:00.674336 28397 ts_tablet_manager.cc:1428] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:01.001370 28404 raft_consensus.cc:482] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:01.001488 28404 raft_consensus.cc:504] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:01.001724 28404 leader_election.cc:288] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb41ab96fd624529bc1bae2601fa2747 (127.24.71.194:39881), 24cc5e62e64348b3a275fb9832f0e8e0 (127.24.71.195:45457)
I20260808 09:58:01.002020 28146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6462aeeb5231495abf8d2ccd9e4cb66e" candidate_uuid: "c84ad11af230488887d604a8acabf378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" is_pre_election: true
I20260808 09:58:01.002125 28146 raft_consensus.cc:2454] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c84ad11af230488887d604a8acabf378 in term 0.
I20260808 09:58:01.002059 27931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6462aeeb5231495abf8d2ccd9e4cb66e" candidate_uuid: "c84ad11af230488887d604a8acabf378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb41ab96fd624529bc1bae2601fa2747" is_pre_election: true
I20260808 09:58:01.002189 27931 raft_consensus.cc:2454] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c84ad11af230488887d604a8acabf378 in term 0.
I20260808 09:58:01.002329 27633 leader_election.cc:302] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cc5e62e64348b3a275fb9832f0e8e0, c84ad11af230488887d604a8acabf378; no voters:
I20260808 09:58:01.002449 28404 raft_consensus.cc:2781] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:58:01.002503 28404 raft_consensus.cc:482] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:58:01.002555 28404 raft_consensus.cc:3037] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:01.003356 28404 raft_consensus.cc:504] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:01.003572 28404 leader_election.cc:288] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [CANDIDATE]: Term 1 election: Requested vote from peers eb41ab96fd624529bc1bae2601fa2747 (127.24.71.194:39881), 24cc5e62e64348b3a275fb9832f0e8e0 (127.24.71.195:45457)
I20260808 09:58:01.003775 27931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6462aeeb5231495abf8d2ccd9e4cb66e" candidate_uuid: "c84ad11af230488887d604a8acabf378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb41ab96fd624529bc1bae2601fa2747"
I20260808 09:58:01.003767 28146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6462aeeb5231495abf8d2ccd9e4cb66e" candidate_uuid: "c84ad11af230488887d604a8acabf378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cc5e62e64348b3a275fb9832f0e8e0"
I20260808 09:58:01.003870 28146 raft_consensus.cc:3037] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:01.003870 27931 raft_consensus.cc:3037] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:01.004521 27931 raft_consensus.cc:2454] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84ad11af230488887d604a8acabf378 in term 1.
I20260808 09:58:01.004528 28146 raft_consensus.cc:2454] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84ad11af230488887d604a8acabf378 in term 1.
I20260808 09:58:01.004727 27628 leader_election.cc:302] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 24cc5e62e64348b3a275fb9832f0e8e0, c84ad11af230488887d604a8acabf378, eb41ab96fd624529bc1bae2601fa2747; no voters:
I20260808 09:58:01.004844 28404 raft_consensus.cc:2781] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:01.004911 28404 raft_consensus.cc:686] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [term 1 LEADER]: Becoming Leader. State: Replica: c84ad11af230488887d604a8acabf378, State: Running, Role: LEADER
I20260808 09:58:01.004962 28404 consensus_queue.cc:237] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } }
I20260808 09:58:01.005602 27492 catalog_manager.cc:5495] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 reported cstate change: term changed from 0 to 1, leader changed from <none> to c84ad11af230488887d604a8acabf378 (127.24.71.193). New cstate: current_term: 1 leader_uuid: "c84ad11af230488887d604a8acabf378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84ad11af230488887d604a8acabf378" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 43221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 } health_report { overall_health: UNKNOWN } } }
I20260808 09:58:01.030923 28146 raft_consensus.cc:1261] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Refusing update from remote peer c84ad11af230488887d604a8acabf378: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:01.030915 27931 raft_consensus.cc:1261] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Refusing update from remote peer c84ad11af230488887d604a8acabf378: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:01.031178 28423 consensus_queue.cc:1035] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cc5e62e64348b3a275fb9832f0e8e0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 45457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:01.031325 28404 consensus_queue.cc:1035] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb41ab96fd624529bc1bae2601fa2747" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 39881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:01.032774 28345 mvcc.cc:205] Tried to move back new op lower bound from 7316205899900989440 to 7316205899796570112. Current Snapshot: MvccSnapshot[applied={T|T < 7316205899900989440}]
W20260808 09:58:01.036573 28347 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 09:58:02.557488 27490 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:02.557633 27490 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:02.558621 27490 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3216aed82764591b387600f3352cfb2: Sending DeleteTablet for 3 replicas of tablet 6462aeeb5231495abf8d2ccd9e4cb66e
I20260808 09:58:02.558879 27706 tablet_service.cc:1514] Processing DeleteTablet for tablet 6462aeeb5231495abf8d2ccd9e4cb66e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:02 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:55200
I20260808 09:58:02.559083 28466 tablet_replica.cc:330] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378: stopping tablet replica
I20260808 09:58:02.559101 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 27597
I20260808 09:58:02.559132 28466 raft_consensus.cc:2229] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [term 1 LEADER]: Raft consensus shutting down.
I20260808 09:58:02.559185 28466 raft_consensus.cc:2258] T 6462aeeb5231495abf8d2ccd9e4cb66e P c84ad11af230488887d604a8acabf378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:02.559686 28116 tablet_service.cc:1514] Processing DeleteTablet for tablet 6462aeeb5231495abf8d2ccd9e4cb66e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:02 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:38178
I20260808 09:58:02.568789 28467 tablet_replica.cc:330] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0: stopping tablet replica
I20260808 09:58:02.568771 27907 tablet_service.cc:1514] Processing DeleteTablet for tablet 6462aeeb5231495abf8d2ccd9e4cb66e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:02 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:33842
I20260808 09:58:02.568902 28467 raft_consensus.cc:2229] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:02.568964 28467 raft_consensus.cc:2258] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:02.569096 28468 tablet_replica.cc:330] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747: stopping tablet replica
I20260808 09:58:02.569167 28468 raft_consensus.cc:2229] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:02.569221 28468 raft_consensus.cc:2258] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:02.569306 28467 ts_tablet_manager.cc:1905] T 6462aeeb5231495abf8d2ccd9e4cb66e P 24cc5e62e64348b3a275fb9832f0e8e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:02.569535 28468 ts_tablet_manager.cc:1905] T 6462aeeb5231495abf8d2ccd9e4cb66e P eb41ab96fd624529bc1bae2601fa2747: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 09:58:02.574545 27471 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:43221 (error 108)
I20260808 09:58:02.574808 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 27817
I20260808 09:58:02.580528 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:02.579199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:43221 (local address 127.0.0.1:55222)
0808 09:58:02.580376 (+ 1177us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:02.580459 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:43221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1137,"thread_start_us":1078,"threads_started":1}
W20260808 09:58:02.581293 27471 catalog_manager.cc:4584] TS c84ad11af230488887d604a8acabf378 (127.24.71.193:43221): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6462aeeb5231495abf8d2ccd9e4cb66e: Network error: Client connection negotiation failed: client connection to 127.24.71.193:43221: connect: Connection refused (error 111)
I20260808 09:58:02.634279 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:02.634104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:43221 (local address 127.0.0.1:55234)
0808 09:58:02.634184 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:02.634236 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:43221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 09:58:02.634739 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:02.634636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:43221 (local address 127.0.0.1:55246)
0808 09:58:02.634685 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:02.634718 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:43221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 09:58:02.652901 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:02.652736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:39881 (local address 127.0.0.1:33860)
0808 09:58:02.652814 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:02.652852 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.194:39881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 09:58:02.652896 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 28022
I20260808 09:58:02.663671 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 27444
I20260808 09:58:02.663713 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:02.663554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:45457 (local address 127.0.0.1:38190)
0808 09:58:02.663624 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:02.663662 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.195:45457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
2026-08-08T09:58:02Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6969 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:58:04 dist-test-slave-gw5c krb5kdc[28473](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:58:04 dist-test-slave-gw5c krb5kdc[28473](info): set up 2 sockets
Aug 08 09:58:04 dist-test-slave-gw5c krb5kdc[28473](info): commencing operation
krb5kdc: starting...
W20260808 09:58:05.364966 24863 mini_kdc.cc:121] Time spent starting KDC: real 2.665s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:58:05 dist-test-slave-gw5c krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:58:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:58:05.497977 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:35087
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:39339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:35087
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:05.582965 28492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:05.583185 28492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:05.583210 28492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:05.584903 28492 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:05.584990 28492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:05.585014 28492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:05.585033 28492 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:05.585055 28492 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:05.586758 28492 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:39339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:35087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:35087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:05.587049 28492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:05.587296 28492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 09:58:05.592525 28492 server_base.cc:1034] running on GCE node
W20260808 09:58:05.592631 28499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:05.592633 28501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:05.592778 28505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:05.593104 28492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:05.593446 28492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:05.594632 28492 hybrid_clock.cc:648] HybridClock initialized: now 1786183085594629 us; error 42 us; skew 500 ppm
Aug 08 09:58:05 dist-test-slave-gw5c krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183085, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:05.601018 28492 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:58:05.601536 28492 webserver.cc:460] Webserver started at http://127.24.71.254:40141/ using document root <none> and password file <none>
I20260808 09:58:05.601789 28492 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:05.601861 28492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:05.602017 28492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:05.603189 28492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "ccf15706843b4d0b9a1abf3560abc640"
format_stamp: "Formatted at 2026-08-08 09:58:05 on dist-test-slave-gw5c"
server_key: "f382b14225b616fe5e19948e8008eaeb"
server_key_iv: "435b10724b6226b594732aec5185139b"
server_key_version: "encryptionkey@0"
I20260808 09:58:05.603590 28492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "ccf15706843b4d0b9a1abf3560abc640"
format_stamp: "Formatted at 2026-08-08 09:58:05 on dist-test-slave-gw5c"
server_key: "f382b14225b616fe5e19948e8008eaeb"
server_key_iv: "435b10724b6226b594732aec5185139b"
server_key_version: "encryptionkey@0"
I20260808 09:58:05.605000 28492 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:05.605789 28521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:05.606001 28492 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:05.606112 28492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "ccf15706843b4d0b9a1abf3560abc640"
format_stamp: "Formatted at 2026-08-08 09:58:05 on dist-test-slave-gw5c"
server_key: "f382b14225b616fe5e19948e8008eaeb"
server_key_iv: "435b10724b6226b594732aec5185139b"
server_key_version: "encryptionkey@0"
I20260808 09:58:05.606189 28492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:05.614252 28492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:05.616611 28492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:05.616775 28492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:05.621218 28492 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:35087
I20260808 09:58:05.621276 28589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:35087 every 8 connection(s)
I20260808 09:58:05.621655 28492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:05.622601 28591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:05.623603 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 28492
I20260808 09:58:05.623709 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:05.623891 24863 external_mini_cluster.cc:1428] Setting key d9a89b680f9c3cd47433bea4aa22c0c1
I20260808 09:58:05.626067 28591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640: Bootstrap starting.
I20260808 09:58:05.626714 28591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:05.627010 28591 log.cc:824] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:05.627856 28591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640: No bootstrap required, opened a new log
I20260808 09:58:05.630460 28591 raft_consensus.cc:348] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccf15706843b4d0b9a1abf3560abc640" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35087 } }
I20260808 09:58:05.630597 28591 raft_consensus.cc:374] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:05.630620 28591 raft_consensus.cc:729] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf15706843b4d0b9a1abf3560abc640, State: Initialized, Role: FOLLOWER
I20260808 09:58:05.630754 28591 consensus_queue.cc:260] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccf15706843b4d0b9a1abf3560abc640" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35087 } }
I20260808 09:58:05.630831 28591 raft_consensus.cc:388] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:05.630853 28591 raft_consensus.cc:482] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:05.630930 28591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [term 0 FOLLOWER]: Advancing to term 1
Aug 08 09:58:05 dist-test-slave-gw5c krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:05.631634 28591 raft_consensus.cc:504] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccf15706843b4d0b9a1abf3560abc640" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35087 } }
I20260808 09:58:05.631740 28591 leader_election.cc:302] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ccf15706843b4d0b9a1abf3560abc640; no voters:
I20260808 09:58:05.631947 28591 leader_election.cc:288] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:05.631973 28599 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:05.632093 28599 raft_consensus.cc:686] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [term 1 LEADER]: Becoming Leader. State: Replica: ccf15706843b4d0b9a1abf3560abc640, State: Running, Role: LEADER
I20260808 09:58:05.632197 28599 consensus_queue.cc:237] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccf15706843b4d0b9a1abf3560abc640" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35087 } }
I20260808 09:58:05.632265 28591 sys_catalog.cc:564] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:05.632527 28599 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ccf15706843b4d0b9a1abf3560abc640" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccf15706843b4d0b9a1abf3560abc640" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35087 } } }
I20260808 09:58:05.632601 28599 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:05.632688 28600 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ccf15706843b4d0b9a1abf3560abc640. Latest consensus state: current_term: 1 leader_uuid: "ccf15706843b4d0b9a1abf3560abc640" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccf15706843b4d0b9a1abf3560abc640" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35087 } } }
I20260808 09:58:05.632781 28600 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:05.632966 28606 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:05.633502 28606 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:05.635123 28606 catalog_manager.cc:1347] Generated new cluster ID: c5555c57896f40ea9341908bb378bb22
I20260808 09:58:05.635178 28606 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:05.642493 28597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:05.624432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54134 (local address 127.24.71.254:35087)
0808 09:58:05.624615 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:05.624623 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:05.624650 (+ 27us) server_negotiation.cc:407] Connection header received
0808 09:58:05.625059 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:05.625064 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:05.625109 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:05.625222 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:05.626027 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:05.627119 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:05.628172 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:05.628599 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:05.628689 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:05.631605 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:05.631609 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:05.631610 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:05.631622 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:05.640630 (+ 9008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:05.641142 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:05.641145 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:05.641146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:05.641269 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:05.641524 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:05.641525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:05.641526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:05.641830 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:05.641994 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:05.642118 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 09:58:05.642259 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":97,"threads_started":1}
I20260808 09:58:05.642904 28606 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:05.643496 28606 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:05.647176 28606 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ccf15706843b4d0b9a1abf3560abc640: Generated new TSK 0
I20260808 09:58:05.647360 28606 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 09:58:05.680778 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35087
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:39339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:05.771733 28630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:05.771944 28630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:05.771967 28630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:05.773154 28630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:05.773200 28630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:05.773226 28630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:05.774751 28630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:39339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:05.775014 28630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:05.775280 28630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:05.781241 28636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:05.781241 28639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:05.781210 28637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:05.781482 28630 server_base.cc:1034] running on GCE node
I20260808 09:58:05.781771 28630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:05.782035 28630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:05.783203 28630 hybrid_clock.cc:648] HybridClock initialized: now 1786183085783146 us; error 85 us; skew 500 ppm
Aug 08 09:58:05 dist-test-slave-gw5c krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183085, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:05.785967 28630 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 09:58:05.786439 28630 webserver.cc:460] Webserver started at http://127.24.71.193:40429/ using document root <none> and password file <none>
I20260808 09:58:05.786692 28630 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:05.786772 28630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:05.786963 28630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:05.788333 28630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "5f0a56ba3f394038822e16864befe91b"
format_stamp: "Formatted at 2026-08-08 09:58:05 on dist-test-slave-gw5c"
server_key: "7df6041874be87f96f41dd25906dd519"
server_key_iv: "a0a8e7e4a08b41a40e7abd44daa5adff"
server_key_version: "encryptionkey@0"
I20260808 09:58:05.788820 28630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "5f0a56ba3f394038822e16864befe91b"
format_stamp: "Formatted at 2026-08-08 09:58:05 on dist-test-slave-gw5c"
server_key: "7df6041874be87f96f41dd25906dd519"
server_key_iv: "a0a8e7e4a08b41a40e7abd44daa5adff"
server_key_version: "encryptionkey@0"
I20260808 09:58:05.790269 28630 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:05.791079 28648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:05.791265 28630 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:05.791368 28630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "5f0a56ba3f394038822e16864befe91b"
format_stamp: "Formatted at 2026-08-08 09:58:05 on dist-test-slave-gw5c"
server_key: "7df6041874be87f96f41dd25906dd519"
server_key_iv: "a0a8e7e4a08b41a40e7abd44daa5adff"
server_key_version: "encryptionkey@0"
I20260808 09:58:05.791486 28630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:05.806770 28630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:05.808784 28630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:05.808969 28630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:05.809266 28630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:05.809616 28630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:05.809676 28630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:05.809719 28630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:05.809746 28630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:05.815973 28630 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:39535
I20260808 09:58:05.816061 28812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:39535 every 8 connection(s)
I20260808 09:58:05.816439 28630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 09:58:05.817543 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 28630
I20260808 09:58:05.817648 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:58:05.817838 24863 external_mini_cluster.cc:1428] Setting key 57dc2e325e94add3456bf70fba47ff33
Aug 08 09:58:05 dist-test-slave-gw5c krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183085, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:05.826835 28597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:05.817338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:55375 (local address 127.24.71.254:35087)
0808 09:58:05.817427 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:05.817429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:05.817661 (+ 232us) server_negotiation.cc:407] Connection header received
0808 09:58:05.818298 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:05.818299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:05.818309 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:05.818356 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:05.819435 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:05.819956 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:05.821001 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:05.821300 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:05.821376 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:05.823728 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:05.823730 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:05.823730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:05.823739 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:05.825384 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:05.825797 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:05.825798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:05.825798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:05.825865 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:05.826108 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:05.826109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:05.826109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:05.826253 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:05.826328 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:05.826590 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 09:58:05.826696 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 09:58:05.826841 28816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:05.817303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35087 (local address 127.24.71.193:55375)
0808 09:58:05.817535 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:05.817579 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:05.818204 (+ 625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:05.818428 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:05.818432 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:05.819096 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:05.819296 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:05.819301 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:05.820086 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:05.820087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:05.820896 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:05.820898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:05.821401 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:05.821402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:05.821517 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:05.822083 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:05.822091 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:05.823625 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:05.825482 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:05.825489 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:05.825490 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:05.825718 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:05.825938 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:05.825938 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:05.825939 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:05.826038 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:05.826330 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:05.826336 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:05.826454 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 09:58:05.826536 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 09:58:05.826658 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":137,"threads_started":1}
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
I20260808 09:58:05.827425 28814 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35087
I20260808 09:58:05.827536 28814 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:05.827749 28814 heartbeater.cc:511] Master 127.24.71.254:35087 requested a full tablet report, sending...
I20260808 09:58:05.828330 28542 ts_manager.cc:194] Registered new tserver with Master: 5f0a56ba3f394038822e16864befe91b (127.24.71.193:39535)
I20260808 09:58:05.828979 28542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:55375
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 09:58:05.847316 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35087
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:39339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:05.930775 28822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:05.930997 28822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:05.931021 28822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:05.932243 28822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:05.932292 28822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:05.932320 28822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:05.933889 28822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:39339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:05.934162 28822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:05.934404 28822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:05.939695 28836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:05.939682 28834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:05.939812 28822 server_base.cc:1034] running on GCE node
W20260808 09:58:05.939669 28838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:05.940171 28822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:05.940403 28822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:05.941546 28822 hybrid_clock.cc:648] HybridClock initialized: now 1786183085941538 us; error 33 us; skew 500 ppm
Aug 08 09:58:05 dist-test-slave-gw5c krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183085, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:05.944236 28822 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 09:58:05.944694 28822 webserver.cc:460] Webserver started at http://127.24.71.194:40497/ using document root <none> and password file <none>
I20260808 09:58:05.944954 28822 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:05.945027 28822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:05.945178 28822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:05.946236 28822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "ae326df2af1a468f8e66906132e014cf"
format_stamp: "Formatted at 2026-08-08 09:58:05 on dist-test-slave-gw5c"
server_key: "02899504c47e5909ca98aa4c05141cae"
server_key_iv: "6b3387405524246558b6a42ab48eb7ab"
server_key_version: "encryptionkey@0"
I20260808 09:58:05.946623 28822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "ae326df2af1a468f8e66906132e014cf"
format_stamp: "Formatted at 2026-08-08 09:58:05 on dist-test-slave-gw5c"
server_key: "02899504c47e5909ca98aa4c05141cae"
server_key_iv: "6b3387405524246558b6a42ab48eb7ab"
server_key_version: "encryptionkey@0"
I20260808 09:58:05.948069 28822 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:05.948872 28847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:05.949051 28822 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:05.949155 28822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "ae326df2af1a468f8e66906132e014cf"
format_stamp: "Formatted at 2026-08-08 09:58:05 on dist-test-slave-gw5c"
server_key: "02899504c47e5909ca98aa4c05141cae"
server_key_iv: "6b3387405524246558b6a42ab48eb7ab"
server_key_version: "encryptionkey@0"
I20260808 09:58:05.949241 28822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:05.972234 28822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:05.974850 28822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:05.975036 28822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:05.975307 28822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:05.975684 28822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:05.975741 28822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:05.975777 28822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:05.975821 28822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:05.981788 28822 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:36589
I20260808 09:58:05.981877 29012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:36589 every 8 connection(s)
I20260808 09:58:05.982229 28822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:58:05.983445 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 28822
I20260808 09:58:05.983557 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:58:05.983747 24863 external_mini_cluster.cc:1428] Setting key 28a3bf2eee547323e0b280662f3e3684
Aug 08 09:58:05 dist-test-slave-gw5c krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183085, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
I20260808 09:58:05.993734 28597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:05.983102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:35313 (local address 127.24.71.254:35087)
0808 09:58:05.983191 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:05.983195 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:05.983349 (+ 154us) server_negotiation.cc:407] Connection header received
0808 09:58:05.984081 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:05.984083 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:05.984095 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:05.984184 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:05.985279 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:05.986039 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:05.987654 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:05.987861 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:05.987923 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:05.990543 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:05.990545 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:05.990545 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:05.990553 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:05.992210 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:05.992660 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:05.992662 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:05.992662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:05.992729 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:05.993008 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:05.993009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:05.993009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:05.993137 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:05.993218 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:05.993533 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 09:58:05.993625 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 09:58:05.993968 29017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:05.983016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35087 (local address 127.24.71.194:35313)
0808 09:58:05.983190 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:05.983235 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:05.983944 (+ 709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:05.984260 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:05.984264 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:05.984968 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:05.985175 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:05.985180 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:05.986138 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:05.986138 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:05.987562 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:05.987565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:05.987952 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:05.987953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:05.988107 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:05.988669 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:05.988680 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:05.990430 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:05.992322 (+ 1892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:05.992331 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:05.992334 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:05.992576 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:05.992810 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:05.992811 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:05.992812 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:05.992930 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:05.993207 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:05.993214 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:05.993374 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 09:58:05.993508 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 09:58:05.993708 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":97,"threads_started":1}
I20260808 09:58:05.994606 29013 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35087
I20260808 09:58:05.994741 29013 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:05.994927 29013 heartbeater.cc:511] Master 127.24.71.254:35087 requested a full tablet report, sending...
I20260808 09:58:05.995424 28542 ts_manager.cc:194] Registered new tserver with Master: ae326df2af1a468f8e66906132e014cf (127.24.71.194:36589)
I20260808 09:58:05.995855 28542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:35313
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 09:58:06.014041 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35087
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:39339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:06.098569 29020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:06.098783 29020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:06.098812 29020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:06.100091 29020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:06.100139 29020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:06.100165 29020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:06.101554 29020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:39339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:06.101753 29020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:06.101943 29020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:06.106885 29026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:06.106956 29028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:06.106930 29025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:06.107136 29020 server_base.cc:1034] running on GCE node
I20260808 09:58:06.107359 29020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:06.107646 29020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:06.108819 29020 hybrid_clock.cc:648] HybridClock initialized: now 1786183086108811 us; error 37 us; skew 500 ppm
Aug 08 09:58:06 dist-test-slave-gw5c krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183086, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:06.111577 29020 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 09:58:06.111987 29020 webserver.cc:460] Webserver started at http://127.24.71.195:39557/ using document root <none> and password file <none>
I20260808 09:58:06.112229 29020 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:06.112286 29020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:06.112422 29020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:06.113498 29020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "347c1483b68a4eeca32e070761c0050b"
format_stamp: "Formatted at 2026-08-08 09:58:06 on dist-test-slave-gw5c"
server_key: "bc2e7095a43495fa6c38b43c09504917"
server_key_iv: "6f2286820725bb3351cd4381a2335acc"
server_key_version: "encryptionkey@0"
I20260808 09:58:06.113873 29020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "347c1483b68a4eeca32e070761c0050b"
format_stamp: "Formatted at 2026-08-08 09:58:06 on dist-test-slave-gw5c"
server_key: "bc2e7095a43495fa6c38b43c09504917"
server_key_iv: "6f2286820725bb3351cd4381a2335acc"
server_key_version: "encryptionkey@0"
I20260808 09:58:06.115446 29020 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:06.116421 29038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:06.116647 29020 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:06.116758 29020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "347c1483b68a4eeca32e070761c0050b"
format_stamp: "Formatted at 2026-08-08 09:58:06 on dist-test-slave-gw5c"
server_key: "bc2e7095a43495fa6c38b43c09504917"
server_key_iv: "6f2286820725bb3351cd4381a2335acc"
server_key_version: "encryptionkey@0"
I20260808 09:58:06.116847 29020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:06.128460 29020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:06.130496 29020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:06.130836 29020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:06.131134 29020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:06.131547 29020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:06.131609 29020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:06.131655 29020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:06.131699 29020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:06.138947 29020 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:36293
I20260808 09:58:06.139027 29207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:36293 every 8 connection(s)
I20260808 09:58:06.139482 29020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:58:06.140384 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 29020
I20260808 09:58:06.140506 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:58:06.140707 24863 external_mini_cluster.cc:1428] Setting key 96045abf8e1ebfd046129e16237a633d
Aug 08 09:58:06 dist-test-slave-gw5c krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183086, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:06.149610 28597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:06.140359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:51203 (local address 127.24.71.254:35087)
0808 09:58:06.140439 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:06.140442 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:06.140679 (+ 237us) server_negotiation.cc:407] Connection header received
0808 09:58:06.141445 (+ 766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:06.141446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:06.141459 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:06.141514 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:06.142539 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:06.143067 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:06.144151 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:06.144358 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:06.144414 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:06.146533 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:06.146535 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:06.146535 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:06.146542 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:06.148207 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:06.148583 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:06.148584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:06.148584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:06.148662 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:06.148891 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:06.148891 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:06.148892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:06.148996 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:06.149047 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:06.149470 (+ 423us) server_negotiation.cc:299] Negotiation successful
0808 09:58:06.149543 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 09:58:06.149792 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:06.140332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35087 (local address 127.24.71.195:51203)
0808 09:58:06.140523 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:06.140566 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:06.141281 (+ 715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:06.141593 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:06.141597 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:06.142236 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:06.142440 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:06.142445 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:06.143173 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:06.143174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:06.144071 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:06.144074 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:06.144440 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:06.144441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:06.144550 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:06.145026 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:06.145041 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:06.146440 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:06.148285 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:06.148291 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:06.148293 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:06.148516 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:06.148721 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:06.148721 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:06.148722 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:06.148834 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:06.149135 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:06.149142 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:06.149326 (+ 184us) client_negotiation.cc:769] Sending connection context
0808 09:58:06.149433 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 09:58:06.149564 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":110,"threads_started":1}
I20260808 09:58:06.150444 29208 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35087
I20260808 09:58:06.150662 29208 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:06.150874 29208 heartbeater.cc:511] Master 127.24.71.254:35087 requested a full tablet report, sending...
I20260808 09:58:06.151486 28542 ts_manager.cc:194] Registered new tserver with Master: 347c1483b68a4eeca32e070761c0050b (127.24.71.195:36293)
I20260808 09:58:06.151975 28542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:51203
I20260808 09:58:06.152631 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 09:58:06.164832 28597 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:06.163997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54150 (local address 127.24.71.254:35087)
0808 09:58:06.164066 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:06.164071 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:06.164162 (+ 91us) server_negotiation.cc:407] Connection header received
0808 09:58:06.164205 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:06.164206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:06.164215 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:06.164274 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:06.164775 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54150: BlockingRecv error: recv got EOF from 127.0.0.1:54150 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 09:58:06.165771 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 28630
I20260808 09:58:06.183444 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 28822
I20260808 09:58:06.195240 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 29020
I20260808 09:58:06.208377 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 28492
2026-08-08T09:58:06Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3536 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:58:06 dist-test-slave-gw5c krb5kdc[29221](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:58:06 dist-test-slave-gw5c krb5kdc[29221](info): set up 2 sockets
Aug 08 09:58:06 dist-test-slave-gw5c krb5kdc[29221](info): commencing operation
krb5kdc: starting...
W20260808 09:58:07.525861 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:58:07 dist-test-slave-gw5c krb5kdc[29221](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:58:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:58:07.654981 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:41087
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:46759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:41087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:07.738721 29236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:07.738953 29236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:07.738996 29236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:07.740152 29236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:07.740188 29236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:07.740202 29236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:07.740216 29236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:07.740228 29236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:07.741729 29236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:46759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:41087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:41087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:07.741956 29236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:07.742154 29236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:07.746974 29243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:07.746985 29244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:07.747046 29247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:07.747690 29236 server_base.cc:1034] running on GCE node
I20260808 09:58:07.748016 29236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:07.748328 29236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:07.749492 29236 hybrid_clock.cc:648] HybridClock initialized: now 1786183087749472 us; error 36 us; skew 500 ppm
Aug 08 09:58:07 dist-test-slave-gw5c krb5kdc[29221](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183087, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:07.752132 29236 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:58:07.752641 29236 webserver.cc:460] Webserver started at http://127.24.71.254:33797/ using document root <none> and password file <none>
I20260808 09:58:07.752887 29236 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:07.752961 29236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:07.753114 29236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:07.754202 29236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "27eae5f4735c49e48a2c0fc383546e38"
format_stamp: "Formatted at 2026-08-08 09:58:07 on dist-test-slave-gw5c"
server_key: "498d7815c3057747345cd8e2a82e3d8e"
server_key_iv: "c1eb5b5be59e772497313fc4340352d0"
server_key_version: "encryptionkey@0"
I20260808 09:58:07.754575 29236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "27eae5f4735c49e48a2c0fc383546e38"
format_stamp: "Formatted at 2026-08-08 09:58:07 on dist-test-slave-gw5c"
server_key: "498d7815c3057747345cd8e2a82e3d8e"
server_key_iv: "c1eb5b5be59e772497313fc4340352d0"
server_key_version: "encryptionkey@0"
I20260808 09:58:07.756055 29236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:07.756846 29257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:07.757035 29236 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:07.757149 29236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "27eae5f4735c49e48a2c0fc383546e38"
format_stamp: "Formatted at 2026-08-08 09:58:07 on dist-test-slave-gw5c"
server_key: "498d7815c3057747345cd8e2a82e3d8e"
server_key_iv: "c1eb5b5be59e772497313fc4340352d0"
server_key_version: "encryptionkey@0"
I20260808 09:58:07.757225 29236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:07.794610 29236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:07.796655 29236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:07.796844 29236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:07.801618 29236 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:41087
I20260808 09:58:07.801662 29334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:41087 every 8 connection(s)
I20260808 09:58:07.802174 29236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:07.802903 29335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:07.805256 29335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38: Bootstrap starting.
I20260808 09:58:07.805857 29335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:07.806119 29335 log.cc:824] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:07.806805 29335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38: No bootstrap required, opened a new log
I20260808 09:58:07.808409 29335 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27eae5f4735c49e48a2c0fc383546e38" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41087 } }
I20260808 09:58:07.808568 29335 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:07.808593 29335 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27eae5f4735c49e48a2c0fc383546e38, State: Initialized, Role: FOLLOWER
I20260808 09:58:07.808697 29335 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27eae5f4735c49e48a2c0fc383546e38" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41087 } }
I20260808 09:58:07.808789 29335 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:07.808828 29335 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:07.808880 29335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:07.809813 29335 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27eae5f4735c49e48a2c0fc383546e38" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41087 } }
I20260808 09:58:07.809952 29335 leader_election.cc:302] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27eae5f4735c49e48a2c0fc383546e38; no voters:
I20260808 09:58:07.810146 29335 leader_election.cc:288] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:07.810293 29340 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:07.810539 29340 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [term 1 LEADER]: Becoming Leader. State: Replica: 27eae5f4735c49e48a2c0fc383546e38, State: Running, Role: LEADER
I20260808 09:58:07.810606 29335 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:07.810628 29340 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27eae5f4735c49e48a2c0fc383546e38" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41087 } }
I20260808 09:58:07.810994 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 29236
I20260808 09:58:07.811107 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:07.811336 24863 external_mini_cluster.cc:1428] Setting key 63a7523fe92f5d6d1e76f2c8820417a4
I20260808 09:58:07.811836 29345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27eae5f4735c49e48a2c0fc383546e38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27eae5f4735c49e48a2c0fc383546e38" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41087 } } }
I20260808 09:58:07.811928 29345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:07.812129 29346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27eae5f4735c49e48a2c0fc383546e38. Latest consensus state: current_term: 1 leader_uuid: "27eae5f4735c49e48a2c0fc383546e38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27eae5f4735c49e48a2c0fc383546e38" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41087 } } }
I20260808 09:58:07.812314 29346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:07.812218 29366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:07.812841 29366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:07.814867 29366 catalog_manager.cc:1347] Generated new cluster ID: bd98f1caf22a4051a43d1877682d6b9a
I20260808 09:58:07.814937 29366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 09:58:07 dist-test-slave-gw5c krb5kdc[29221](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:07.823544 29363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:07.811861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43246 (local address 127.24.71.254:41087)
0808 09:58:07.812261 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:07.812271 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:07.812393 (+ 122us) server_negotiation.cc:407] Connection header received
0808 09:58:07.812523 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:07.812530 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:07.812595 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:07.812767 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:07.813588 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:07.814756 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:07.815853 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:07.816467 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:07.816576 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:07.819480 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:07.819485 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:07.819485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:07.819500 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:07.821679 (+ 2179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:07.822111 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:07.822115 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:07.822116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:07.822256 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:07.822474 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:07.822475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:07.822476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:07.822844 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:07.823027 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:07.823102 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 09:58:07.823257 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":75,"threads_started":1}
I20260808 09:58:07.824718 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 09:58:07.827487 29366 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:07.828236 29366 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:07.832454 29366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27eae5f4735c49e48a2c0fc383546e38: Generated new TSK 0
I20260808 09:58:07.832597 29366 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 09:58:07.843472 29363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:07.839365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43248 (local address 127.24.71.254:41087)
0808 09:58:07.839453 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:07.839455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:07.839593 (+ 138us) server_negotiation.cc:407] Connection header received
0808 09:58:07.839663 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:07.839664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:07.839674 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:07.839742 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:07.840311 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:07.840841 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:07.841954 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:07.842169 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:07.842223 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:07.842944 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:07.842946 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:07.842946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:07.843143 (+ 197us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:07.843160 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:07.843166 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:07.843218 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:07.843305 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 09:58:07.843329 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 09:58:07.846303 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 29236
2026-08-08T09:58:07Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1634 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:58:07 dist-test-slave-gw5c krb5kdc[29390](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:58:07 dist-test-slave-gw5c krb5kdc[29390](info): set up 2 sockets
Aug 08 09:58:07 dist-test-slave-gw5c krb5kdc[29390](info): commencing operation
krb5kdc: starting...
W20260808 09:58:09.123744 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:58:09 dist-test-slave-gw5c krb5kdc[29390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183089, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:58:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:58:09.250818 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:44917
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:44917
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:09.337564 29408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:09.337836 29408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:09.337877 29408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:09.339150 29408 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:09.339226 29408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:09.339258 29408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:09.339287 29408 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:09.339314 29408 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:09.340862 29408 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:44917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:44917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:09.341153 29408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:09.341399 29408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:09.346436 29415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:09.346441 29414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:09.346432 29419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:09.346911 29408 server_base.cc:1034] running on GCE node
I20260808 09:58:09.347169 29408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:09.347500 29408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:09.348680 29408 hybrid_clock.cc:648] HybridClock initialized: now 1786183089348673 us; error 43 us; skew 500 ppm
Aug 08 09:58:09 dist-test-slave-gw5c krb5kdc[29390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183089, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:09.351455 29408 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:58:09.351953 29408 webserver.cc:460] Webserver started at http://127.24.71.254:40301/ using document root <none> and password file <none>
I20260808 09:58:09.352196 29408 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:09.352275 29408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:09.352437 29408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:09.353559 29408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "47b541a145a44413b36318de4cd59a08"
format_stamp: "Formatted at 2026-08-08 09:58:09 on dist-test-slave-gw5c"
server_key: "6a16e1efcd151465eba098923d68612c"
server_key_iv: "33bcad5f1820e285a774e7e659a8fd04"
server_key_version: "encryptionkey@0"
I20260808 09:58:09.353947 29408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "47b541a145a44413b36318de4cd59a08"
format_stamp: "Formatted at 2026-08-08 09:58:09 on dist-test-slave-gw5c"
server_key: "6a16e1efcd151465eba098923d68612c"
server_key_iv: "33bcad5f1820e285a774e7e659a8fd04"
server_key_version: "encryptionkey@0"
I20260808 09:58:09.355466 29408 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:09.356298 29428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:09.356488 29408 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:09.356594 29408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "47b541a145a44413b36318de4cd59a08"
format_stamp: "Formatted at 2026-08-08 09:58:09 on dist-test-slave-gw5c"
server_key: "6a16e1efcd151465eba098923d68612c"
server_key_iv: "33bcad5f1820e285a774e7e659a8fd04"
server_key_version: "encryptionkey@0"
I20260808 09:58:09.356689 29408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:09.382256 29408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:09.384491 29408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:09.384656 29408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:09.388934 29408 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:44917
I20260808 09:58:09.388980 29506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:44917 every 8 connection(s)
I20260808 09:58:09.389400 29408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:09.390460 29509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:09.392874 29509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08: Bootstrap starting.
I20260808 09:58:09.393477 29509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:09.393774 29509 log.cc:824] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:09.394510 29509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08: No bootstrap required, opened a new log
I20260808 09:58:09.396160 29509 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b541a145a44413b36318de4cd59a08" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 44917 } }
I20260808 09:58:09.396298 29509 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:09.396368 29509 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b541a145a44413b36318de4cd59a08, State: Initialized, Role: FOLLOWER
I20260808 09:58:09.396560 29509 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b541a145a44413b36318de4cd59a08" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 44917 } }
I20260808 09:58:09.396646 29509 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:09.396696 29509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:09.396749 29509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:09.397250 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 29408
I20260808 09:58:09.397338 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:09.397521 24863 external_mini_cluster.cc:1428] Setting key 403ccbc5e73f3e4fc18ab2b817424b06
I20260808 09:58:09.397647 29509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b541a145a44413b36318de4cd59a08" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 44917 } }
I20260808 09:58:09.397770 29509 leader_election.cc:302] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47b541a145a44413b36318de4cd59a08; no voters:
I20260808 09:58:09.397987 29516 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:09.398159 29516 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [term 1 LEADER]: Becoming Leader. State: Replica: 47b541a145a44413b36318de4cd59a08, State: Running, Role: LEADER
I20260808 09:58:09.398193 29509 leader_election.cc:288] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:09.398401 29516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b541a145a44413b36318de4cd59a08" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 44917 } }
I20260808 09:58:09.398532 29509 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:09.398826 29516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47b541a145a44413b36318de4cd59a08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b541a145a44413b36318de4cd59a08" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 44917 } } }
I20260808 09:58:09.398953 29516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:09.399245 29530 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:09.399704 29520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47b541a145a44413b36318de4cd59a08. Latest consensus state: current_term: 1 leader_uuid: "47b541a145a44413b36318de4cd59a08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b541a145a44413b36318de4cd59a08" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 44917 } } }
I20260808 09:58:09.399801 29520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:09.399963 29530 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 09:58:09 dist-test-slave-gw5c krb5kdc[29390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183089, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:09.405222 29530 catalog_manager.cc:1347] Generated new cluster ID: 9d77804326ba4917891e1ff0b890b0a4
I20260808 09:58:09.405292 29530 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:09.409629 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:09.398032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56586 (local address 127.24.71.254:44917)
0808 09:58:09.398247 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:09.398258 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:09.398297 (+ 39us) server_negotiation.cc:407] Connection header received
0808 09:58:09.398419 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:09.398426 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:09.398482 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:09.398606 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:09.399515 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.400987 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.401877 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.402495 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.402610 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:09.405203 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:09.405209 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:09.405209 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:09.405223 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:09.407380 (+ 2157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:09.407844 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:09.407847 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:09.407847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:09.407985 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:09.408216 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:09.408216 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:09.408217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:09.408541 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:09.408670 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:09.409239 (+ 569us) server_negotiation.cc:299] Negotiation successful
0808 09:58:09.409389 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":109,"threads_started":1}
I20260808 09:58:09.412531 29530 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:09.413146 29530 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:09.417884 29530 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47b541a145a44413b36318de4cd59a08: Generated new TSK 0
I20260808 09:58:09.418131 29530 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 09:58:09.446514 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:44917
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:09.531287 29548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:09.531530 29548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:09.531555 29548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:09.532779 29548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:09.532828 29548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:09.532855 29548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:09.534307 29548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:44917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:09.534509 29548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:09.534705 29548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:09.539858 29555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:09.539950 29556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:09.539871 29560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:09.540128 29548 server_base.cc:1034] running on GCE node
I20260808 09:58:09.540372 29548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:09.540608 29548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:09.541770 29548 hybrid_clock.cc:648] HybridClock initialized: now 1786183089541760 us; error 34 us; skew 500 ppm
Aug 08 09:58:09 dist-test-slave-gw5c krb5kdc[29390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183089, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:09.544786 29548 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 09:58:09.545341 29548 webserver.cc:460] Webserver started at http://127.24.71.193:32857/ using document root <none> and password file <none>
I20260808 09:58:09.545632 29548 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:09.545717 29548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:09.545907 29548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:09.547122 29548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "385c4726bec740438b85af93b0a77f03"
format_stamp: "Formatted at 2026-08-08 09:58:09 on dist-test-slave-gw5c"
server_key: "8d30f854762d24c7053d4357f8b7c8cc"
server_key_iv: "ac5a90aee6a696948ba8e38c92dd322b"
server_key_version: "encryptionkey@0"
I20260808 09:58:09.547610 29548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "385c4726bec740438b85af93b0a77f03"
format_stamp: "Formatted at 2026-08-08 09:58:09 on dist-test-slave-gw5c"
server_key: "8d30f854762d24c7053d4357f8b7c8cc"
server_key_iv: "ac5a90aee6a696948ba8e38c92dd322b"
server_key_version: "encryptionkey@0"
I20260808 09:58:09.549247 29548 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 09:58:09.550184 29572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:09.550410 29548 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:09.550532 29548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "385c4726bec740438b85af93b0a77f03"
format_stamp: "Formatted at 2026-08-08 09:58:09 on dist-test-slave-gw5c"
server_key: "8d30f854762d24c7053d4357f8b7c8cc"
server_key_iv: "ac5a90aee6a696948ba8e38c92dd322b"
server_key_version: "encryptionkey@0"
I20260808 09:58:09.550614 29548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:09.562440 29548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:09.565012 29548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:09.565198 29548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:09.565474 29548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:09.565814 29548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:09.565871 29548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:09.565912 29548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:09.565938 29548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:09.572144 29548 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:43615
I20260808 09:58:09.572192 29733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:43615 every 8 connection(s)
I20260808 09:58:09.572578 29548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
Aug 08 09:58:09 dist-test-slave-gw5c krb5kdc[29390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183089, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:09.582520 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 29548
I20260808 09:58:09.582547 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:09.573359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:43497 (local address 127.24.71.254:44917)
0808 09:58:09.573440 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:09.573442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:09.573691 (+ 249us) server_negotiation.cc:407] Connection header received
0808 09:58:09.574282 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:09.574283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:09.574304 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:09.574372 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:09.575504 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.576033 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.577023 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.577275 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.577339 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:09.579945 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:09.579946 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:09.579946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:09.579954 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:09.581231 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:09.581631 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:09.581631 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:09.581632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:09.581684 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:09.581903 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:09.581903 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:09.581904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:09.582004 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:09.582056 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:09.582334 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 09:58:09.582428 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 09:58:09.582631 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:58:09.582643 29740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:09.573344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:44917 (local address 127.24.71.193:43497)
0808 09:58:09.573527 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:09.573566 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:09.574123 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:09.574483 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:09.574487 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:09.575125 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:09.575343 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:09.575348 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.576116 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.576117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:09.576935 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:09.576937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.577399 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.577400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:09.577530 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:09.578079 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:09.578087 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:09.579847 (+ 1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:09.581324 (+ 1477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:09.581331 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:09.581333 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:09.581560 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:09.581745 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:09.581746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:09.581746 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:09.581848 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:09.582058 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:09.582063 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:09.582180 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 09:58:09.582292 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 09:58:09.582425 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":117,"threads_started":1}
I20260808 09:58:09.582831 24863 external_mini_cluster.cc:1428] Setting key a71ad27e5c070eed2f17697dd29de2e6
I20260808 09:58:09.583309 29737 heartbeater.cc:347] Connected to a master server at 127.24.71.254:44917
I20260808 09:58:09.583439 29737 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:09.583635 29737 heartbeater.cc:511] Master 127.24.71.254:44917 requested a full tablet report, sending...
I20260808 09:58:09.584206 29447 ts_manager.cc:194] Registered new tserver with Master: 385c4726bec740438b85af93b0a77f03 (127.24.71.193:43615)
I20260808 09:58:09.584848 29447 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:43497
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 09:58:09.611303 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:44917
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:09.695955 29746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:09.696172 29746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:09.696195 29746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:09.697417 29746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:09.697467 29746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:09.697494 29746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:09.699141 29746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:44917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:09.699434 29746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:09.699702 29746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:09.704775 29752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:09.704775 29757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:09.704867 29753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:09.705180 29746 server_base.cc:1034] running on GCE node
I20260808 09:58:09.705353 29746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:09.705557 29746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:09.706707 29746 hybrid_clock.cc:648] HybridClock initialized: now 1786183089706692 us; error 29 us; skew 500 ppm
Aug 08 09:58:09 dist-test-slave-gw5c krb5kdc[29390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183089, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:09.709404 29746 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 09:58:09.709923 29746 webserver.cc:460] Webserver started at http://127.24.71.194:33691/ using document root <none> and password file <none>
I20260808 09:58:09.710187 29746 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:09.710261 29746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:09.710417 29746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:09.711599 29746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "eb8178f47a9b4615a9174f3a3d852a78"
format_stamp: "Formatted at 2026-08-08 09:58:09 on dist-test-slave-gw5c"
server_key: "ba164b09ff0c081a7f4dc59e7957d9f4"
server_key_iv: "bc9bcba2214ac45a3d6cf25dd458a10d"
server_key_version: "encryptionkey@0"
I20260808 09:58:09.711989 29746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "eb8178f47a9b4615a9174f3a3d852a78"
format_stamp: "Formatted at 2026-08-08 09:58:09 on dist-test-slave-gw5c"
server_key: "ba164b09ff0c081a7f4dc59e7957d9f4"
server_key_iv: "bc9bcba2214ac45a3d6cf25dd458a10d"
server_key_version: "encryptionkey@0"
I20260808 09:58:09.713472 29746 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 09:58:09.714334 29770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:09.714538 29746 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:09.714650 29746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "eb8178f47a9b4615a9174f3a3d852a78"
format_stamp: "Formatted at 2026-08-08 09:58:09 on dist-test-slave-gw5c"
server_key: "ba164b09ff0c081a7f4dc59e7957d9f4"
server_key_iv: "bc9bcba2214ac45a3d6cf25dd458a10d"
server_key_version: "encryptionkey@0"
I20260808 09:58:09.714728 29746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:09.726899 29746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:09.729007 29746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:09.729180 29746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:09.729422 29746 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:09.729760 29746 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:09.729816 29746 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:09.729858 29746 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:09.729887 29746 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:09.735807 29746 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:35011
I20260808 09:58:09.735864 29937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:35011 every 8 connection(s)
I20260808 09:58:09.736230 29746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:58:09.737214 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 29746
I20260808 09:58:09.737315 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:58:09.737530 24863 external_mini_cluster.cc:1428] Setting key 903c6123d52622305567efb4537df3de
Aug 08 09:58:09 dist-test-slave-gw5c krb5kdc[29390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183089, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
I20260808 09:58:09.747694 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:09.737054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:36057 (local address 127.24.71.254:44917)
0808 09:58:09.737140 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:09.737142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:09.737391 (+ 249us) server_negotiation.cc:407] Connection header received
0808 09:58:09.738021 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:09.738022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:09.738032 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:09.738075 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:09.739101 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.739676 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.741237 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.741439 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.741517 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:09.744215 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:09.744217 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:09.744217 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:09.744263 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:09.745886 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:09.746421 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:09.746421 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:09.746422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:09.746482 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:09.746796 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:09.746797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:09.746797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:09.746915 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:09.746972 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:09.747539 (+ 567us) server_negotiation.cc:299] Negotiation successful
0808 09:58:09.747622 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 09:58:09.747798 29941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:09.736952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:44917 (local address 127.24.71.194:36057)
0808 09:58:09.737215 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:09.737263 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:09.737916 (+ 653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:09.738145 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:09.738149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:09.738763 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:09.738964 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:09.738983 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.739769 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.739770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:09.741133 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:09.741136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.741521 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.741523 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:09.741659 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:09.742252 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:09.742260 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:09.744095 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:09.745993 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:09.746001 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:09.746003 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:09.746328 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:09.746560 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:09.746561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:09.746561 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:09.746718 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:09.746990 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:09.746996 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:09.747167 (+ 171us) client_negotiation.cc:769] Sending connection context
0808 09:58:09.747304 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 09:58:09.747522 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":106,"threads_started":1}
I20260808 09:58:09.748379 29939 heartbeater.cc:347] Connected to a master server at 127.24.71.254:44917
I20260808 09:58:09.748502 29939 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:09.748672 29939 heartbeater.cc:511] Master 127.24.71.254:44917 requested a full tablet report, sending...
I20260808 09:58:09.749045 29447 ts_manager.cc:194] Registered new tserver with Master: eb8178f47a9b4615a9174f3a3d852a78 (127.24.71.194:35011)
I20260808 09:58:09.749508 29447 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:36057
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 09:58:09.764390 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:44917
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:09.847434 29945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:09.847692 29945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:09.847731 29945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:09.848886 29945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:09.848963 29945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:09.849009 29945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:09.850492 29945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:44917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:09.850780 29945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:09.851019 29945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:09.856236 29955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:09.856243 29956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:09.856495 29958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:09.856472 29945 server_base.cc:1034] running on GCE node
I20260808 09:58:09.856702 29945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:09.856920 29945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:09.858098 29945 hybrid_clock.cc:648] HybridClock initialized: now 1786183089858080 us; error 29 us; skew 500 ppm
Aug 08 09:58:09 dist-test-slave-gw5c krb5kdc[29390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183089, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:09.860993 29945 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 09:58:09.861436 29945 webserver.cc:460] Webserver started at http://127.24.71.195:43727/ using document root <none> and password file <none>
I20260808 09:58:09.861699 29945 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:09.861747 29945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:09.861900 29945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:09.862988 29945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "8d5abda3a7a549939e537d278d768d5b"
format_stamp: "Formatted at 2026-08-08 09:58:09 on dist-test-slave-gw5c"
server_key: "53b6882d4ffebeacfa4eff21e0e81928"
server_key_iv: "935330234af9935129146843a0cb2838"
server_key_version: "encryptionkey@0"
I20260808 09:58:09.863343 29945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "8d5abda3a7a549939e537d278d768d5b"
format_stamp: "Formatted at 2026-08-08 09:58:09 on dist-test-slave-gw5c"
server_key: "53b6882d4ffebeacfa4eff21e0e81928"
server_key_iv: "935330234af9935129146843a0cb2838"
server_key_version: "encryptionkey@0"
I20260808 09:58:09.864708 29945 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:09.865447 29965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:09.865624 29945 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:09.865732 29945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "8d5abda3a7a549939e537d278d768d5b"
format_stamp: "Formatted at 2026-08-08 09:58:09 on dist-test-slave-gw5c"
server_key: "53b6882d4ffebeacfa4eff21e0e81928"
server_key_iv: "935330234af9935129146843a0cb2838"
server_key_version: "encryptionkey@0"
I20260808 09:58:09.865806 29945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:09.888917 29945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:09.891547 29945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:09.891729 29945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:09.891994 29945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:09.892340 29945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:09.892400 29945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:09.892446 29945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:09.892489 29945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:09.898527 29945 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:37893
I20260808 09:58:09.898620 30122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:37893 every 8 connection(s)
I20260808 09:58:09.898944 29945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:58:09.900172 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 29945
I20260808 09:58:09.900275 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:58:09.900477 24863 external_mini_cluster.cc:1428] Setting key 799ca20765d49486d064d50bcac23302
Aug 08 09:58:09 dist-test-slave-gw5c krb5kdc[29390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183089, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:09.908748 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:09.899950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:60107 (local address 127.24.71.254:44917)
0808 09:58:09.900016 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:09.900019 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:09.900234 (+ 215us) server_negotiation.cc:407] Connection header received
0808 09:58:09.900889 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:09.900891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:09.900906 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:09.900975 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:09.902091 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.902597 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.903717 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.903942 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.904022 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:09.906081 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:09.906082 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:09.906082 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:09.906090 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:09.907331 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:09.907866 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:09.907868 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:09.907868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:09.907928 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:09.908160 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:09.908161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:09.908162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:09.908286 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:09.908344 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:09.908599 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 09:58:09.908667 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 09:58:09.908910 30126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:09.899909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:44917 (local address 127.24.71.195:60107)
0808 09:58:09.900076 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:09.900120 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:09.900759 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:09.901059 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:09.901063 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:09.901774 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:09.901977 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:09.901982 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.902699 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.902700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:09.903615 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:09.903618 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.904026 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.904028 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:09.904159 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:09.904624 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:09.904632 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:09.905991 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:09.907535 (+ 1544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:09.907541 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:09.907543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:09.907779 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:09.907997 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:09.907997 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:09.907998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:09.908101 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:09.908347 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:09.908351 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:09.908483 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 09:58:09.908567 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 09:58:09.908691 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":85,"threads_started":1}
I20260808 09:58:09.909466 30123 heartbeater.cc:347] Connected to a master server at 127.24.71.254:44917
I20260808 09:58:09.909581 30123 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:09.909775 30123 heartbeater.cc:511] Master 127.24.71.254:44917 requested a full tablet report, sending...
I20260808 09:58:09.910207 29447 ts_manager.cc:194] Registered new tserver with Master: 8d5abda3a7a549939e537d278d768d5b (127.24.71.195:37893)
I20260808 09:58:09.910589 29447 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:60107
I20260808 09:58:09.912192 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 09:58:09 dist-test-slave-gw5c krb5kdc[29390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183089, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 09:58:09 dist-test-slave-gw5c krb5kdc[29390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183089, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:09.936803 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:09.929060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56590 (local address 127.24.71.254:44917)
0808 09:58:09.929153 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:09.929155 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:09.929259 (+ 104us) server_negotiation.cc:407] Connection header received
0808 09:58:09.929363 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:09.929364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:09.929379 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:09.929451 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:09.930064 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.930570 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.931321 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:09.931588 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:09.931676 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:09.934029 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:09.934031 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:09.934031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:09.934040 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:09.935525 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:09.935874 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:09.935876 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:09.935876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:09.935937 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:09.936161 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:09.936162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:09.936162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:09.936338 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:09.936444 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:09.936598 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 09:58:09.936691 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260808 09:58:09.937098 29447 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:56590
I20260808 09:58:09.937752 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 29548
I20260808 09:58:09.949404 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 29746
I20260808 09:58:09.960531 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 29945
I20260808 09:58:09.966995 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 29408
2026-08-08T09:58:09Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2123 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:58:10 dist-test-slave-gw5c krb5kdc[30139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:58:10 dist-test-slave-gw5c krb5kdc[30139](info): set up 2 sockets
Aug 08 09:58:10 dist-test-slave-gw5c krb5kdc[30139](info): commencing operation
krb5kdc: starting...
W20260808 09:58:11.216336 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:58:11 dist-test-slave-gw5c krb5kdc[30139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:58:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:58:11.341703 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:46357
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:46357
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:11.427271 30160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:11.427560 30160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:11.427603 30160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:11.428773 30160 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:11.428843 30160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:11.428869 30160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:11.428898 30160 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:11.428928 30160 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:11.430433 30160 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:46357
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:46357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:11.430708 30160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:11.430944 30160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:11.436010 30173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:11.435992 30169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:11.435969 30171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:11.436028 30160 server_base.cc:1034] running on GCE node
I20260808 09:58:11.436510 30160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:11.436811 30160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:11.437965 30160 hybrid_clock.cc:648] HybridClock initialized: now 1786183091437946 us; error 36 us; skew 500 ppm
Aug 08 09:58:11 dist-test-slave-gw5c krb5kdc[30139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183091, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:11.445551 30160 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:58:11.446034 30160 webserver.cc:460] Webserver started at http://127.24.71.254:40595/ using document root <none> and password file <none>
I20260808 09:58:11.446269 30160 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:11.446316 30160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:11.446460 30160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:11.447646 30160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "a99e4b2cc72148bf95b20aa1534e7d61"
format_stamp: "Formatted at 2026-08-08 09:58:11 on dist-test-slave-gw5c"
server_key: "db1864f4e0586a7dc2427a32f3d74f46"
server_key_iv: "5aa6432064e5af396e75bd6d95c2ca78"
server_key_version: "encryptionkey@0"
I20260808 09:58:11.448009 30160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "a99e4b2cc72148bf95b20aa1534e7d61"
format_stamp: "Formatted at 2026-08-08 09:58:11 on dist-test-slave-gw5c"
server_key: "db1864f4e0586a7dc2427a32f3d74f46"
server_key_iv: "5aa6432064e5af396e75bd6d95c2ca78"
server_key_version: "encryptionkey@0"
I20260808 09:58:11.449433 30160 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 09:58:11.450204 30182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:11.450414 30160 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:11.450510 30160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "a99e4b2cc72148bf95b20aa1534e7d61"
format_stamp: "Formatted at 2026-08-08 09:58:11 on dist-test-slave-gw5c"
server_key: "db1864f4e0586a7dc2427a32f3d74f46"
server_key_iv: "5aa6432064e5af396e75bd6d95c2ca78"
server_key_version: "encryptionkey@0"
I20260808 09:58:11.450565 30160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:11.475709 30160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:11.478281 30160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:11.478413 30160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:11.482512 30160 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:46357
I20260808 09:58:11.482589 30251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:46357 every 8 connection(s)
I20260808 09:58:11.483071 30160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:11.483916 30252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:11.486565 30252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61: Bootstrap starting.
I20260808 09:58:11.487179 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 30160
I20260808 09:58:11.487310 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:11.487345 30252 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:11.487561 24863 external_mini_cluster.cc:1428] Setting key f1324edeca724057e8685018d9fd656c
I20260808 09:58:11.487766 30252 log.cc:824] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:11.488590 30252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61: No bootstrap required, opened a new log
I20260808 09:58:11.490602 30252 raft_consensus.cc:348] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99e4b2cc72148bf95b20aa1534e7d61" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46357 } }
I20260808 09:58:11.490770 30252 raft_consensus.cc:374] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:11.490825 30252 raft_consensus.cc:729] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99e4b2cc72148bf95b20aa1534e7d61, State: Initialized, Role: FOLLOWER
I20260808 09:58:11.491004 30252 consensus_queue.cc:260] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99e4b2cc72148bf95b20aa1534e7d61" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46357 } }
I20260808 09:58:11.491107 30252 raft_consensus.cc:388] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:11.491156 30252 raft_consensus.cc:482] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:11.491209 30252 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:11.491874 30252 raft_consensus.cc:504] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99e4b2cc72148bf95b20aa1534e7d61" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46357 } }
I20260808 09:58:11.492002 30252 leader_election.cc:302] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a99e4b2cc72148bf95b20aa1534e7d61; no voters:
I20260808 09:58:11.492239 30252 leader_election.cc:288] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:11.492267 30261 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:11.492486 30261 raft_consensus.cc:686] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [term 1 LEADER]: Becoming Leader. State: Replica: a99e4b2cc72148bf95b20aa1534e7d61, State: Running, Role: LEADER
I20260808 09:58:11.492647 30252 sys_catalog.cc:564] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:11.492651 30261 consensus_queue.cc:237] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99e4b2cc72148bf95b20aa1534e7d61" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46357 } }
I20260808 09:58:11.493029 30263 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a99e4b2cc72148bf95b20aa1534e7d61. Latest consensus state: current_term: 1 leader_uuid: "a99e4b2cc72148bf95b20aa1534e7d61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99e4b2cc72148bf95b20aa1534e7d61" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46357 } } }
I20260808 09:58:11.493115 30263 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:11.493695 30270 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:11.494234 30270 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 09:58:11 dist-test-slave-gw5c krb5kdc[30139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:11.495153 30264 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a99e4b2cc72148bf95b20aa1534e7d61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99e4b2cc72148bf95b20aa1534e7d61" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46357 } } }
I20260808 09:58:11.495330 30264 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:11.495885 30270 catalog_manager.cc:1347] Generated new cluster ID: 02e77075376d4b9fb6beab2381e2703e
I20260808 09:58:11.495944 30270 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:11.499086 30258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:11.488151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36822 (local address 127.24.71.254:46357)
0808 09:58:11.488371 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:11.488380 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:11.488414 (+ 34us) server_negotiation.cc:407] Connection header received
0808 09:58:11.488908 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:11.488915 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:11.488963 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:11.489107 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:11.489794 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.490649 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.491643 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.492124 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.492275 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:11.495172 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:11.495176 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:11.495176 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:11.495189 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:11.497259 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:11.497615 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:11.497618 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:11.497618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:11.497708 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:11.497888 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:11.497889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:11.497889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:11.498152 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:11.498280 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:11.498732 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 09:58:11.498867 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":104,"threads_started":1}
I20260808 09:58:11.507105 30270 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:11.507894 30270 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:11.511484 30270 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a99e4b2cc72148bf95b20aa1534e7d61: Generated new TSK 0
I20260808 09:58:11.511699 30270 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 09:58:11.540556 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:46357
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:11.624626 30293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:11.624840 30293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:11.624866 30293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:11.626088 30293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:11.626132 30293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:11.626157 30293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:11.627779 30293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:46357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:11.628034 30293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:11.628284 30293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:11.633211 30302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:11.633190 30305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:11.633205 30299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:11.633674 30293 server_base.cc:1034] running on GCE node
I20260808 09:58:11.633886 30293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:11.634078 30293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:11.635241 30293 hybrid_clock.cc:648] HybridClock initialized: now 1786183091635207 us; error 31 us; skew 500 ppm
Aug 08 09:58:11 dist-test-slave-gw5c krb5kdc[30139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183091, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:11.637969 30293 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 09:58:11.638441 30293 webserver.cc:460] Webserver started at http://127.24.71.193:42595/ using document root <none> and password file <none>
I20260808 09:58:11.638682 30293 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:11.638728 30293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:11.638872 30293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:11.640002 30293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "d364bff31c9b4aaebca016529df01f64"
format_stamp: "Formatted at 2026-08-08 09:58:11 on dist-test-slave-gw5c"
server_key: "6ae1aa67df29d2e81c6b822f5fdddc19"
server_key_iv: "e68aea2556faf4a875c32944d6cd3ff9"
server_key_version: "encryptionkey@0"
I20260808 09:58:11.640384 30293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "d364bff31c9b4aaebca016529df01f64"
format_stamp: "Formatted at 2026-08-08 09:58:11 on dist-test-slave-gw5c"
server_key: "6ae1aa67df29d2e81c6b822f5fdddc19"
server_key_iv: "e68aea2556faf4a875c32944d6cd3ff9"
server_key_version: "encryptionkey@0"
I20260808 09:58:11.641750 30293 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 09:58:11.642539 30316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:11.642755 30293 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:11.642824 30293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "d364bff31c9b4aaebca016529df01f64"
format_stamp: "Formatted at 2026-08-08 09:58:11 on dist-test-slave-gw5c"
server_key: "6ae1aa67df29d2e81c6b822f5fdddc19"
server_key_iv: "e68aea2556faf4a875c32944d6cd3ff9"
server_key_version: "encryptionkey@0"
I20260808 09:58:11.642925 30293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:11.658908 30293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:11.661398 30293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:11.661557 30293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:11.661828 30293 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:11.662158 30293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:11.662194 30293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:11.662215 30293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:11.662271 30293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:11.668206 30293 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:34881
I20260808 09:58:11.668285 30481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:34881 every 8 connection(s)
I20260808 09:58:11.668617 30293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
Aug 08 09:58:11 dist-test-slave-gw5c krb5kdc[30139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183091, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:11.676297 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 30293
I20260808 09:58:11.676465 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:58:11.676666 24863 external_mini_cluster.cc:1428] Setting key 40cb804df503f8c23641a80575f7f633
I20260808 09:58:11.678465 30484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:11.669376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:46357 (local address 127.24.71.193:52437)
0808 09:58:11.669578 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:11.669623 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:11.670570 (+ 947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:11.670853 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:11.670857 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:11.671121 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:11.671311 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:11.671315 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.672076 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.672078 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:11.672886 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:11.672889 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.673323 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.673323 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:11.673450 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:11.673942 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:11.673951 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:11.675303 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:11.677066 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:11.677073 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:11.677075 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:11.677326 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:11.677574 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:11.677575 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:11.677575 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:11.677679 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:11.677969 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:11.677974 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:11.678088 (+ 114us) client_negotiation.cc:769] Sending connection context
0808 09:58:11.678173 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 09:58:11.678295 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":93,"threads_started":1}
I20260808 09:58:11.678469 30258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:11.669429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:52437 (local address 127.24.71.254:46357)
0808 09:58:11.669528 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:11.669531 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:11.669717 (+ 186us) server_negotiation.cc:407] Connection header received
0808 09:58:11.670702 (+ 985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:11.670704 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:11.670717 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:11.670766 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:11.671461 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.671975 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.672996 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.673217 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.673308 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:11.675438 (+ 2130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:11.675440 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:11.675440 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:11.675448 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:11.676987 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:11.677421 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:11.677421 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:11.677422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:11.677496 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:11.677748 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:11.677749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:11.677750 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:11.677903 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:11.677976 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:11.678218 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 09:58:11.678324 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 09:58:11.679011 30482 heartbeater.cc:347] Connected to a master server at 127.24.71.254:46357
I20260808 09:58:11.679136 30482 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:11.679359 30482 heartbeater.cc:511] Master 127.24.71.254:46357 requested a full tablet report, sending...
I20260808 09:58:11.679911 30208 ts_manager.cc:194] Registered new tserver with Master: d364bff31c9b4aaebca016529df01f64 (127.24.71.193:34881)
I20260808 09:58:11.680528 30208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:52437
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 09:58:11.703894 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:46357
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:11.786456 30489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:11.786700 30489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:11.786737 30489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:11.787885 30489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:11.787952 30489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:11.787995 30489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:11.789490 30489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:46357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:11.789754 30489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:11.789986 30489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:11.795256 30497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:11.795296 30496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:11.795295 30501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:11.795615 30489 server_base.cc:1034] running on GCE node
I20260808 09:58:11.795818 30489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:11.796018 30489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:11.797199 30489 hybrid_clock.cc:648] HybridClock initialized: now 1786183091797185 us; error 40 us; skew 500 ppm
Aug 08 09:58:11 dist-test-slave-gw5c krb5kdc[30139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183091, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:11.800028 30489 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 09:58:11.800514 30489 webserver.cc:460] Webserver started at http://127.24.71.194:40375/ using document root <none> and password file <none>
I20260808 09:58:11.800748 30489 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:11.800817 30489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:11.800974 30489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:11.802027 30489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "41405d075e3644598cc215180f68acd4"
format_stamp: "Formatted at 2026-08-08 09:58:11 on dist-test-slave-gw5c"
server_key: "cecc330fcba4404384898b41e5920e20"
server_key_iv: "d4c9df22206b89052fdac8944c06f84d"
server_key_version: "encryptionkey@0"
I20260808 09:58:11.802395 30489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "41405d075e3644598cc215180f68acd4"
format_stamp: "Formatted at 2026-08-08 09:58:11 on dist-test-slave-gw5c"
server_key: "cecc330fcba4404384898b41e5920e20"
server_key_iv: "d4c9df22206b89052fdac8944c06f84d"
server_key_version: "encryptionkey@0"
I20260808 09:58:11.803817 30489 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 09:58:11.804584 30513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:11.804795 30489 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:11.804908 30489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "41405d075e3644598cc215180f68acd4"
format_stamp: "Formatted at 2026-08-08 09:58:11 on dist-test-slave-gw5c"
server_key: "cecc330fcba4404384898b41e5920e20"
server_key_iv: "d4c9df22206b89052fdac8944c06f84d"
server_key_version: "encryptionkey@0"
I20260808 09:58:11.804981 30489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:11.816605 30489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:11.818630 30489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:11.818799 30489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:11.819051 30489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:11.819375 30489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:11.819489 30489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:11.819535 30489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:11.819567 30489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:11.825603 30489 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:34215
I20260808 09:58:11.825646 30679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:34215 every 8 connection(s)
I20260808 09:58:11.825960 30489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:58:11.829303 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 30489
I20260808 09:58:11.829414 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:58:11.829600 24863 external_mini_cluster.cc:1428] Setting key e4e61925e18e6a69aea3a16bcfb8240a
Aug 08 09:58:11 dist-test-slave-gw5c krb5kdc[30139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183091, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:11.836027 30258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:11.826683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:38361 (local address 127.24.71.254:46357)
0808 09:58:11.826782 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:11.826785 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:11.826969 (+ 184us) server_negotiation.cc:407] Connection header received
0808 09:58:11.827949 (+ 980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:11.827950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:11.827963 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:11.828027 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:11.828671 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.829283 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.830586 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.830872 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.830949 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:11.833161 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:11.833165 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:11.833165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:11.833177 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:11.834552 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:11.835001 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:11.835002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:11.835003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:11.835069 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:11.835351 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:11.835352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:11.835353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:11.835505 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:11.835585 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:11.835852 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 09:58:11.835935 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 09:58:11.836229 30682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:11.826651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:46357 (local address 127.24.71.194:38361)
0808 09:58:11.826832 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:11.826881 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:11.827830 (+ 949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:11.828102 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:11.828106 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:11.828380 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:11.828569 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:11.828574 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.829412 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.829413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:11.830495 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:11.830498 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.830974 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.830974 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:11.831076 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:11.831606 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:11.831615 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:11.833071 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:11.834653 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:11.834660 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:11.834662 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:11.834921 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:11.835138 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:11.835139 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:11.835140 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:11.835244 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:11.835576 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:11.835582 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:11.835717 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 09:58:11.835829 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 09:58:11.835986 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":80,"threads_started":1}
I20260808 09:58:11.836760 30680 heartbeater.cc:347] Connected to a master server at 127.24.71.254:46357
I20260808 09:58:11.836870 30680 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:11.837040 30680 heartbeater.cc:511] Master 127.24.71.254:46357 requested a full tablet report, sending...
I20260808 09:58:11.837414 30208 ts_manager.cc:194] Registered new tserver with Master: 41405d075e3644598cc215180f68acd4 (127.24.71.194:34215)
I20260808 09:58:11.837955 30208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:38361
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 09:58:11.857795 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:46357
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:11.940591 30686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:11.940856 30686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:11.940898 30686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:11.942080 30686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:11.942162 30686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:11.942204 30686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:11.943812 30686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:46357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:11.944110 30686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:11.944360 30686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:11.949613 30691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:11.949579 30692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:11.949580 30694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:11.949982 30686 server_base.cc:1034] running on GCE node
I20260808 09:58:11.950263 30686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:11.950516 30686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:11.951674 30686 hybrid_clock.cc:648] HybridClock initialized: now 1786183091951658 us; error 26 us; skew 500 ppm
Aug 08 09:58:11 dist-test-slave-gw5c krb5kdc[30139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183091, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:11.954511 30686 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 09:58:11.955112 30686 webserver.cc:460] Webserver started at http://127.24.71.195:42469/ using document root <none> and password file <none>
I20260808 09:58:11.955466 30686 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:11.955541 30686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:11.955703 30686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:11.956756 30686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "b10be2ce5e88489f8401a3efbde66a25"
format_stamp: "Formatted at 2026-08-08 09:58:11 on dist-test-slave-gw5c"
server_key: "78422511b916e79aaf956879ae717bb8"
server_key_iv: "00534d8e1cc4ab6c2e564f7fea6aa3e6"
server_key_version: "encryptionkey@0"
I20260808 09:58:11.957130 30686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "b10be2ce5e88489f8401a3efbde66a25"
format_stamp: "Formatted at 2026-08-08 09:58:11 on dist-test-slave-gw5c"
server_key: "78422511b916e79aaf956879ae717bb8"
server_key_iv: "00534d8e1cc4ab6c2e564f7fea6aa3e6"
server_key_version: "encryptionkey@0"
I20260808 09:58:11.958518 30686 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:11.959252 30701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:11.959501 30686 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:11.959604 30686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "b10be2ce5e88489f8401a3efbde66a25"
format_stamp: "Formatted at 2026-08-08 09:58:11 on dist-test-slave-gw5c"
server_key: "78422511b916e79aaf956879ae717bb8"
server_key_iv: "00534d8e1cc4ab6c2e564f7fea6aa3e6"
server_key_version: "encryptionkey@0"
I20260808 09:58:11.959692 30686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:11.970911 30686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:11.973289 30686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:11.973455 30686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:11.973687 30686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:11.974007 30686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:11.974061 30686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:11.974103 30686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:11.974131 30686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:11.980190 30686 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:41041
I20260808 09:58:11.980247 30872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:41041 every 8 connection(s)
I20260808 09:58:11.980608 30686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:58:11.983327 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 30686
I20260808 09:58:11.983474 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:58:11.983670 24863 external_mini_cluster.cc:1428] Setting key 52680f3b933ccdb085bf4253845b5192
Aug 08 09:58:11 dist-test-slave-gw5c krb5kdc[30139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183091, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:11.990324 30258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:11.981378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:49337 (local address 127.24.71.254:46357)
0808 09:58:11.981467 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:11.981469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:11.981643 (+ 174us) server_negotiation.cc:407] Connection header received
0808 09:58:11.982603 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:11.982605 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:11.982618 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:11.982678 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:11.983323 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.984062 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.985269 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.985575 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.985654 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:11.987750 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:11.987751 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:11.987752 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:11.987758 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:11.989185 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:11.989565 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:11.989565 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:11.989566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:11.989617 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:11.989826 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:11.989827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:11.989827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:11.989925 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:11.989975 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:11.990194 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 09:58:11.990258 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 09:58:11.990530 30877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:11.981334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:46357 (local address 127.24.71.195:49337)
0808 09:58:11.981499 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:11.981549 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:11.982484 (+ 935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:11.982744 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:11.982748 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:11.983024 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:11.983214 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:11.983218 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.984214 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.984215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:11.985175 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:11.985177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:11.985659 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:11.985660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:11.985789 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:11.986217 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:11.986224 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:11.987665 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:11.989260 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:11.989265 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:11.989267 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:11.989499 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:11.989673 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:11.989674 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:11.989674 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:11.989773 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:11.989978 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:11.989981 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:11.990092 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 09:58:11.990173 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 09:58:11.990289 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":71,"threads_started":1}
I20260808 09:58:11.991003 30874 heartbeater.cc:347] Connected to a master server at 127.24.71.254:46357
I20260808 09:58:11.991088 30874 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:11.991233 30874 heartbeater.cc:511] Master 127.24.71.254:46357 requested a full tablet report, sending...
I20260808 09:58:11.991647 30208 ts_manager.cc:194] Registered new tserver with Master: b10be2ce5e88489f8401a3efbde66a25 (127.24.71.195:41041)
I20260808 09:58:11.992033 30208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:49337
I20260808 09:58:11.995714 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 09:58:12 dist-test-slave-gw5c krb5kdc[30139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 09:58:12 dist-test-slave-gw5c krb5kdc[30139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.193@KRBTEST.COM
I20260808 09:58:12.021206 30884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:12.012843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47842 (local address 127.24.71.193:34881)
0808 09:58:12.013036 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:12.013042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:12.013054 (+ 12us) server_negotiation.cc:407] Connection header received
0808 09:58:12.013082 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:12.013084 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:12.013100 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:12.013173 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:12.013826 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:12.014564 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:12.015387 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:12.015808 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:12.015871 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:12.018311 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:12.018323 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:12.018323 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:12.018330 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:12.019964 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:12.020376 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:12.020379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:12.020380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:12.020447 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:12.020644 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:12.020644 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:12.020644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:12.020790 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:12.020922 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:12.020995 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 09:58:12.021067 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":100,"threads_started":1}
Aug 08 09:58:12 dist-test-slave-gw5c krb5kdc[30139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:12.029876 30258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:12.022642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36838 (local address 127.24.71.254:46357)
0808 09:58:12.022703 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:12.022705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:12.022750 (+ 45us) server_negotiation.cc:407] Connection header received
0808 09:58:12.022781 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:12.022782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:12.022792 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:12.022841 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:12.023491 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:12.023993 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:12.024681 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:12.024893 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:12.024953 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:12.027289 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:12.027291 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:12.027292 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:12.027302 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:12.028881 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:12.029199 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:12.029200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:12.029200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:12.029254 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:12.029421 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:12.029421 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:12.029422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:12.029570 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:12.029649 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:12.029732 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 09:58:12.029805 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260808 09:58:12.030262 30208 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36838
I20260808 09:58:12.030695 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 30293
I20260808 09:58:12.048589 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 30489
I20260808 09:58:12.056500 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 30686
I20260808 09:58:12.080613 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 30160
2026-08-08T09:58:12Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2111 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:58:12 dist-test-slave-gw5c krb5kdc[30890](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:58:12 dist-test-slave-gw5c krb5kdc[30890](info): set up 2 sockets
Aug 08 09:58:12 dist-test-slave-gw5c krb5kdc[30890](info): commencing operation
krb5kdc: starting...
W20260808 09:58:13.339064 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:58:13 dist-test-slave-gw5c krb5kdc[30890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:58:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:58:13.470233 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33401
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:43191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:33401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:13.553874 30907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:13.554155 30907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:13.554198 30907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:13.555485 30907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:13.555550 30907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:13.555573 30907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:13.555594 30907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:13.555622 30907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:13.557193 30907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:43191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:33401
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:13.557483 30907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:13.557727 30907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:13.562826 30916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:13.562909 30914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:13.562837 30920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:13.563160 30907 server_base.cc:1034] running on GCE node
I20260808 09:58:13.563524 30907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:13.563820 30907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:13.564998 30907 hybrid_clock.cc:648] HybridClock initialized: now 1786183093564988 us; error 50 us; skew 500 ppm
Aug 08 09:58:13 dist-test-slave-gw5c krb5kdc[30890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183093, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:13.567857 30907 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:58:13.568186 30907 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:13.568243 30907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:13.568338 30907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:13.569482 30907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "ee184e961ca84fbb98b72bca7dbe8834"
format_stamp: "Formatted at 2026-08-08 09:58:13 on dist-test-slave-gw5c"
server_key: "eb42ccab5afe74176e1c091cd91d6341"
server_key_iv: "81aa987b6fa21b7a17d403aed69fbb8f"
server_key_version: "encryptionkey@0"
I20260808 09:58:13.569924 30907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "ee184e961ca84fbb98b72bca7dbe8834"
format_stamp: "Formatted at 2026-08-08 09:58:13 on dist-test-slave-gw5c"
server_key: "eb42ccab5afe74176e1c091cd91d6341"
server_key_iv: "81aa987b6fa21b7a17d403aed69fbb8f"
server_key_version: "encryptionkey@0"
I20260808 09:58:13.571435 30907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 09:58:13.572199 30930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:13.572413 30907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:13.572526 30907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "ee184e961ca84fbb98b72bca7dbe8834"
format_stamp: "Formatted at 2026-08-08 09:58:13 on dist-test-slave-gw5c"
server_key: "eb42ccab5afe74176e1c091cd91d6341"
server_key_iv: "81aa987b6fa21b7a17d403aed69fbb8f"
server_key_version: "encryptionkey@0"
I20260808 09:58:13.572635 30907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:13.607774 30907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:13.609781 30907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:13.609974 30907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:13.614305 30907 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:33401
I20260808 09:58:13.614336 31008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:33401 every 8 connection(s)
I20260808 09:58:13.614650 30907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:13.615886 31009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:13.616039 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 30907
I20260808 09:58:13.616148 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:13.616364 24863 external_mini_cluster.cc:1428] Setting key c168e68170d45e3d44362336f337496b
I20260808 09:58:13.619505 31009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834: Bootstrap starting.
I20260808 09:58:13.620301 31009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:13.620606 31009 log.cc:824] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:13.621407 31009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834: No bootstrap required, opened a new log
Aug 08 09:58:13 dist-test-slave-gw5c krb5kdc[30890](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:13.624089 31009 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee184e961ca84fbb98b72bca7dbe8834" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33401 } }
I20260808 09:58:13.624230 31009 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:13.624253 31009 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee184e961ca84fbb98b72bca7dbe8834, State: Initialized, Role: FOLLOWER
I20260808 09:58:13.624392 31009 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee184e961ca84fbb98b72bca7dbe8834" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33401 } }
I20260808 09:58:13.624492 31009 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:13.624539 31009 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:13.624614 31009 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:13.625205 31009 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee184e961ca84fbb98b72bca7dbe8834" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33401 } }
I20260808 09:58:13.625329 31009 leader_election.cc:302] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee184e961ca84fbb98b72bca7dbe8834; no voters:
I20260808 09:58:13.625550 31009 leader_election.cc:288] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:13.625653 31015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:13.625852 31009 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:13.625898 31015 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [term 1 LEADER]: Becoming Leader. State: Replica: ee184e961ca84fbb98b72bca7dbe8834, State: Running, Role: LEADER
I20260808 09:58:13.626055 31015 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee184e961ca84fbb98b72bca7dbe8834" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33401 } }
I20260808 09:58:13.626459 31015 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee184e961ca84fbb98b72bca7dbe8834. Latest consensus state: current_term: 1 leader_uuid: "ee184e961ca84fbb98b72bca7dbe8834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee184e961ca84fbb98b72bca7dbe8834" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33401 } } }
I20260808 09:58:13.626472 31020 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee184e961ca84fbb98b72bca7dbe8834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee184e961ca84fbb98b72bca7dbe8834" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33401 } } }
I20260808 09:58:13.626637 31020 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:13.626873 31015 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:13.627571 31029 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:13.628165 31029 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:13.628933 31013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:13.616970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59604 (local address 127.24.71.254:33401)
0808 09:58:13.617146 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:13.617162 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:13.617189 (+ 27us) server_negotiation.cc:407] Connection header received
0808 09:58:13.617652 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:13.617659 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:13.617705 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:13.617832 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:13.618655 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:13.619745 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:13.620853 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:13.621401 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:13.621559 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:13.624383 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:13.624388 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:13.624388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:13.624402 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:13.626748 (+ 2346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:13.627217 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:13.627220 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:13.627221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:13.627338 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:13.627668 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:13.627669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:13.627670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:13.627998 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:13.628165 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:13.628571 (+ 406us) server_negotiation.cc:299] Negotiation successful
0808 09:58:13.628715 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":87,"threads_started":1}
I20260808 09:58:13.629765 31029 catalog_manager.cc:1347] Generated new cluster ID: c1a771b8235f4c7482904e0eb6aa2251
I20260808 09:58:13.629817 31029 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:13.656790 31029 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:13.657387 31029 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:13.661980 31029 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834: Generated new TSK 0
I20260808 09:58:13.662178 31029 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 09:58:13.698284 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33401
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:43191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:13.781992 31043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:13.782197 31043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:13.782222 31043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:13.783473 31043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:13.783514 31043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:13.783541 31043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:13.785086 31043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:43191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:13.785349 31043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:13.785586 31043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:13.790592 31049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:13.790652 31051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:13.790637 31055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:13.790903 31043 server_base.cc:1034] running on GCE node
I20260808 09:58:13.791136 31043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:13.791436 31043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:13.792594 31043 hybrid_clock.cc:648] HybridClock initialized: now 1786183093792577 us; error 35 us; skew 500 ppm
Aug 08 09:58:13 dist-test-slave-gw5c krb5kdc[30890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183093, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:13.795235 31043 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 09:58:13.795632 31043 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:13.795684 31043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:13.795783 31043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:13.796780 31043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "dcee5c16581d4e3f9417b4e3033989ef"
format_stamp: "Formatted at 2026-08-08 09:58:13 on dist-test-slave-gw5c"
server_key: "5d8d2ec09eaf86e347e5bb5b39e29626"
server_key_iv: "3488dd8533f5df4338654b4829300cc5"
server_key_version: "encryptionkey@0"
I20260808 09:58:13.797080 31043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "dcee5c16581d4e3f9417b4e3033989ef"
format_stamp: "Formatted at 2026-08-08 09:58:13 on dist-test-slave-gw5c"
server_key: "5d8d2ec09eaf86e347e5bb5b39e29626"
server_key_iv: "3488dd8533f5df4338654b4829300cc5"
server_key_version: "encryptionkey@0"
I20260808 09:58:13.798334 31043 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 09:58:13.798997 31064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:13.799226 31043 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:13.799317 31043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "dcee5c16581d4e3f9417b4e3033989ef"
format_stamp: "Formatted at 2026-08-08 09:58:13 on dist-test-slave-gw5c"
server_key: "5d8d2ec09eaf86e347e5bb5b39e29626"
server_key_iv: "3488dd8533f5df4338654b4829300cc5"
server_key_version: "encryptionkey@0"
I20260808 09:58:13.799379 31043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:13.814059 31043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:13.816696 31043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:13.816839 31043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:13.817051 31043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:13.817426 31043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:13.817467 31043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:13.817494 31043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:13.817548 31043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:13.824239 31043 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:34167
I20260808 09:58:13.824290 31224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:34167 every 8 connection(s)
I20260808 09:58:13.824585 31043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
Aug 08 09:58:13 dist-test-slave-gw5c krb5kdc[30890](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183093, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:13.834148 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 31043
I20260808 09:58:13.834262 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:58:13.834474 24863 external_mini_cluster.cc:1428] Setting key 77a704eab485acc96dcf917113c8bc0c
I20260808 09:58:13.834544 31013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:13.825364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:57087 (local address 127.24.71.254:33401)
0808 09:58:13.825412 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:13.825415 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:13.825619 (+ 204us) server_negotiation.cc:407] Connection header received
0808 09:58:13.826183 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:13.826185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:13.826197 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:13.826288 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:13.827488 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:13.828059 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:13.829138 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:13.829377 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:13.829444 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:13.831560 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:13.831562 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:13.831563 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:13.831570 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:13.833073 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:13.833520 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:13.833521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:13.833521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:13.833574 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:13.833819 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:13.833820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:13.833820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:13.833963 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:13.834034 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:13.834376 (+ 342us) server_negotiation.cc:299] Negotiation successful
0808 09:58:13.834454 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 09:58:13.834774 31227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:13.825290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33401 (local address 127.24.71.193:57087)
0808 09:58:13.825475 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:13.825520 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:13.826086 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:13.826400 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:13.826404 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:13.826680 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:13.827262 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:13.827268 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:13.828153 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:13.828154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:13.828965 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:13.828967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:13.829463 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:13.829464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:13.829565 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:13.830038 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:13.830047 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:13.831471 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:13.833221 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:13.833228 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:13.833230 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:13.833449 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:13.833633 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:13.833634 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:13.833634 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:13.833730 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:13.834042 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:13.834050 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:13.834227 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 09:58:13.834356 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 09:58:13.834530 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":110,"threads_started":1}
I20260808 09:58:13.835472 31225 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33401
I20260808 09:58:13.835572 31225 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:13.835745 31225 heartbeater.cc:511] Master 127.24.71.254:33401 requested a full tablet report, sending...
I20260808 09:58:13.836247 30956 ts_manager.cc:194] Registered new tserver with Master: dcee5c16581d4e3f9417b4e3033989ef (127.24.71.193:34167)
I20260808 09:58:13.836853 30956 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:57087
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 09:58:13.860338 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33401
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:43191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:13.942230 31234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:13.942458 31234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:13.942483 31234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:13.943620 31234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:13.943656 31234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:13.943682 31234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:13.945155 31234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:43191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:13.945359 31234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:13.945560 31234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:13.950574 31242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:13.950580 31239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:13.950582 31240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:13.950982 31234 server_base.cc:1034] running on GCE node
I20260808 09:58:13.951215 31234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:13.951517 31234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:13.952685 31234 hybrid_clock.cc:648] HybridClock initialized: now 1786183093952666 us; error 32 us; skew 500 ppm
Aug 08 09:58:13 dist-test-slave-gw5c krb5kdc[30890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183093, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:13.955269 31234 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 09:58:13.955724 31234 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:13.955799 31234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:13.955960 31234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:13.957037 31234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "4bcb4530bf394bccb98442f9854b0634"
format_stamp: "Formatted at 2026-08-08 09:58:13 on dist-test-slave-gw5c"
server_key: "5d95c87c1f28052b88a531955ec16f66"
server_key_iv: "aef4f6cb81d92328f9fb04b0329f89a3"
server_key_version: "encryptionkey@0"
I20260808 09:58:13.957427 31234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "4bcb4530bf394bccb98442f9854b0634"
format_stamp: "Formatted at 2026-08-08 09:58:13 on dist-test-slave-gw5c"
server_key: "5d95c87c1f28052b88a531955ec16f66"
server_key_iv: "aef4f6cb81d92328f9fb04b0329f89a3"
server_key_version: "encryptionkey@0"
I20260808 09:58:13.958742 31234 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 09:58:13.959595 31249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:13.959760 31234 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:13.959865 31234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "4bcb4530bf394bccb98442f9854b0634"
format_stamp: "Formatted at 2026-08-08 09:58:13 on dist-test-slave-gw5c"
server_key: "5d95c87c1f28052b88a531955ec16f66"
server_key_iv: "aef4f6cb81d92328f9fb04b0329f89a3"
server_key_version: "encryptionkey@0"
I20260808 09:58:13.959940 31234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:13.981747 31234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:13.983793 31234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:13.983968 31234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:13.984211 31234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:13.984547 31234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:13.984616 31234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:13.984660 31234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:13.984709 31234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:13.991048 31234 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:35147
I20260808 09:58:13.991087 31407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:35147 every 8 connection(s)
I20260808 09:58:13.991379 31234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:58:13.995923 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 31234
I20260808 09:58:13.996040 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:58:13.996238 24863 external_mini_cluster.cc:1428] Setting key 77bfe25635022f01a28f1bbf74eb454c
Aug 08 09:58:13 dist-test-slave-gw5c krb5kdc[30890](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183093, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:14.001339 31411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:13.992153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33401 (local address 127.24.71.194:39183)
0808 09:58:13.992364 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:13.992408 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:13.992858 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:13.993064 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:13.993068 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:13.993322 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:13.993827 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:13.993832 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:13.994517 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:13.994518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:13.995312 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:13.995314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:13.995771 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:13.995773 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:13.995931 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:13.996562 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:13.996570 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:13.997968 (+ 1398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:13.999973 (+ 2005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:13.999979 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:13.999981 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:14.000218 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:14.000441 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:14.000442 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:14.000442 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:14.000543 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:14.000836 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:14.000840 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:14.000964 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 09:58:14.001047 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 09:58:14.001169 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":148,"threads_started":1}
I20260808 09:58:14.001348 31013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:13.992211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:39183 (local address 127.24.71.254:33401)
0808 09:58:13.992302 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:13.992305 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:13.992501 (+ 196us) server_negotiation.cc:407] Connection header received
0808 09:58:13.992947 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:13.992948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:13.992959 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:13.993014 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:13.993926 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:13.994434 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:13.995452 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:13.995655 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:13.995726 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:13.998071 (+ 2345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:13.998073 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:13.998073 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:13.998081 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:13.999892 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:14.000301 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:14.000302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:14.000303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:14.000373 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:14.000609 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:14.000609 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:14.000610 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:14.000770 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:14.000843 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.001104 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.001209 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 09:58:14.001901 31408 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33401
I20260808 09:58:14.002018 31408 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:14.002261 31408 heartbeater.cc:511] Master 127.24.71.254:33401 requested a full tablet report, sending...
I20260808 09:58:14.002697 30956 ts_manager.cc:194] Registered new tserver with Master: 4bcb4530bf394bccb98442f9854b0634 (127.24.71.194:35147)
I20260808 09:58:14.003087 30956 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:39183
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 09:58:14.023957 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33401
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:43191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:14.109380 31414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:14.109606 31414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:14.109635 31414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:14.110873 31414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:14.110953 31414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:14.110991 31414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:14.112645 31414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:43191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:14.112854 31414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:14.113044 31414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:14.118084 31423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:14.118084 31426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:14.118103 31424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:14.118444 31414 server_base.cc:1034] running on GCE node
I20260808 09:58:14.118697 31414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:14.118963 31414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:14.120141 31414 hybrid_clock.cc:648] HybridClock initialized: now 1786183094120127 us; error 26 us; skew 500 ppm
Aug 08 09:58:14 dist-test-slave-gw5c krb5kdc[30890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183094, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:14.122884 31414 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 09:58:14.123301 31414 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:14.123374 31414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:14.123582 31414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:14.124673 31414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "46cbd21e8347bea974d2798c58b67183"
server_key_iv: "aeeea79f2378f98e70508c0ff8e715ea"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.125054 31414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "46cbd21e8347bea974d2798c58b67183"
server_key_iv: "aeeea79f2378f98e70508c0ff8e715ea"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.126636 31414 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:14.127671 31434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:14.127831 31414 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:14.127923 31414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "46cbd21e8347bea974d2798c58b67183"
server_key_iv: "aeeea79f2378f98e70508c0ff8e715ea"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.127978 31414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:14.142518 31414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:14.144968 31414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:14.145084 31414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:14.145268 31414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:14.145612 31414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:14.145649 31414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:14.145673 31414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:14.145709 31414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:14.151683 31414 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:43879
I20260808 09:58:14.151721 31603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:43879 every 8 connection(s)
I20260808 09:58:14.152002 31414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
Aug 08 09:58:14 dist-test-slave-gw5c krb5kdc[30890](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183094, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:14.160768 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 31414
I20260808 09:58:14.160867 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:58:14.161093 24863 external_mini_cluster.cc:1428] Setting key 6ce1f834a96d94835ef853a6729c5ba9
I20260808 09:58:14.161777 31013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.152743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:55455 (local address 127.24.71.254:33401)
0808 09:58:14.152846 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.152848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.153008 (+ 160us) server_negotiation.cc:407] Connection header received
0808 09:58:14.153457 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.153458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.153470 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.153526 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:14.154459 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.154962 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.156050 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.156264 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.156335 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.158675 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:14.158677 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:14.158677 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:14.158685 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:14.160111 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:14.160533 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:14.160535 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:14.160535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:14.160604 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:14.160949 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:14.160951 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:14.160952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:14.161099 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:14.161175 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.161585 (+ 410us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.161686 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 09:58:14.162101 31607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.152682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33401 (local address 127.24.71.195:55455)
0808 09:58:14.152870 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:14.152914 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:14.153371 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:14.153578 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:14.153581 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:14.153845 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:14.154359 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:14.154364 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.155045 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.155046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:14.155947 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:14.155950 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.156375 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.156376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:14.156489 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.157064 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:14.157073 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:14.158574 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:14.160199 (+ 1625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:14.160205 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:14.160206 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:14.160444 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:14.160677 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:14.160678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:14.160678 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:14.160830 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:14.161226 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:14.161236 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:14.161419 (+ 183us) client_negotiation.cc:769] Sending connection context
0808 09:58:14.161543 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 09:58:14.161704 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":102,"threads_started":1}
I20260808 09:58:14.162726 31604 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33401
I20260808 09:58:14.162845 31604 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:14.162998 31604 heartbeater.cc:511] Master 127.24.71.254:33401 requested a full tablet report, sending...
I20260808 09:58:14.163372 30956 ts_manager.cc:194] Registered new tserver with Master: 6bf375bf26ec4d5f95bd4cdb67e934cb (127.24.71.195:43879)
I20260808 09:58:14.163872 30956 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:55455
I20260808 09:58:14.173235 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 09:58:14.181180 31013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.174585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59614 (local address 127.24.71.254:33401)
0808 09:58:14.174658 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.174661 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.174752 (+ 91us) server_negotiation.cc:407] Connection header received
0808 09:58:14.174834 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.174835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.174846 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.174897 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:14.175571 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.176065 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.176811 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.177027 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.177106 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.178411 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:14.178412 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:14.178412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:14.178421 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:14.179912 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:14.180295 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:14.180296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:14.180297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:14.180365 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:14.180577 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:14.180578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:14.180578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:14.180744 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:14.180876 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.180989 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.181073 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 09:58:14.183127 30956 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59614:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:58:14.184834 30956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:58:14.191848 31622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.187331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43400 (local address 127.24.71.193:34167)
0808 09:58:14.187697 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.187701 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.187710 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:14.187779 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.187781 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.187799 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.187881 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:14.188167 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.189291 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.190629 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.191371 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.191506 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.191573 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.191711 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.191760 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":135,"threads_started":1}
I20260808 09:58:14.191879 31619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.187198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:43879 (local address 127.0.0.1:46702)
0808 09:58:14.187344 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:14.187385 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:14.187477 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:14.187980 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:14.187983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:14.187984 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:14.188096 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:14.188099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.189390 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.189390 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:14.190851 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:14.190853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.191587 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.191588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:14.191638 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.191641 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:14.191673 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 09:58:14.191747 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":73,"thread_start_us":89,"threads_started":1}
I20260808 09:58:14.192070 31624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.187719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49674 (local address 127.24.71.194:35147)
0808 09:58:14.187966 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.188185 (+ 219us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.188196 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:58:14.188241 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.188244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.188291 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.188393 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:14.188517 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.189202 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.190768 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.191489 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.191547 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.191592 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.191922 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.191974 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":81,"threads_started":1}
I20260808 09:58:14.192109 31627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.187797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:35147 (local address 127.0.0.1:49674)
0808 09:58:14.187905 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:14.187916 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:14.187972 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:14.188392 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:14.188393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:14.188395 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:14.188456 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:14.188458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.189310 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.189311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:14.190675 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:14.190679 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.191636 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.191637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:14.191712 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.191717 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 09:58:14.191779 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 09:58:14.191822 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":107,"thread_start_us":71,"threads_started":1}
I20260808 09:58:14.192102 31623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.187588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46702 (local address 127.24.71.195:43879)
0808 09:58:14.187811 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.187815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.187827 (+ 12us) server_negotiation.cc:407] Connection header received
0808 09:58:14.187862 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.187864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.187879 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.188051 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:14.188157 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.189283 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.190938 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.191490 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.191871 (+ 381us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.191940 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.191968 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.192014 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":125,"threads_started":1}
I20260808 09:58:14.192847 31506 tablet_service.cc:1467] Processing CreateTablet for tablet 9c119aa1b7d1407db35f99596860aa46 (DEFAULT_TABLE table=test-table [id=2cd47a85d30a4ee6b86be8eec73586c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:14.192909 31312 tablet_service.cc:1467] Processing CreateTablet for tablet 9c119aa1b7d1407db35f99596860aa46 (DEFAULT_TABLE table=test-table [id=2cd47a85d30a4ee6b86be8eec73586c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:14.193228 31506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c119aa1b7d1407db35f99596860aa46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:14.193259 31312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c119aa1b7d1407db35f99596860aa46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:14.196213 31620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.187180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:34167 (local address 127.0.0.1:43400)
0808 09:58:14.187343 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:14.187412 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:14.187476 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:14.187978 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:14.187981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:14.187984 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:14.188080 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:14.188082 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.189422 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.189423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:14.190541 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:14.190544 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.191505 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.191506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:14.191595 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.191610 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 09:58:14.191686 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 09:58:14.191746 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":123,"thread_start_us":51,"threads_started":1}
I20260808 09:58:14.196216 31628 tablet_bootstrap.cc:492] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb: Bootstrap starting.
I20260808 09:58:14.196873 31628 tablet_bootstrap.cc:654] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:14.197175 31128 tablet_service.cc:1467] Processing CreateTablet for tablet 9c119aa1b7d1407db35f99596860aa46 (DEFAULT_TABLE table=test-table [id=2cd47a85d30a4ee6b86be8eec73586c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:14.197445 31628 log.cc:824] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:14.197500 31128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c119aa1b7d1407db35f99596860aa46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:14.197813 31630 tablet_bootstrap.cc:492] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634: Bootstrap starting.
I20260808 09:58:14.198256 31628 tablet_bootstrap.cc:492] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb: No bootstrap required, opened a new log
I20260808 09:58:14.198338 31628 ts_tablet_manager.cc:1397] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 09:58:14.198463 31630 tablet_bootstrap.cc:654] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:14.199131 31630 log.cc:824] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:14.199931 31630 tablet_bootstrap.cc:492] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634: No bootstrap required, opened a new log
I20260808 09:58:14.200017 31630 ts_tablet_manager.cc:1397] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 09:58:14.200359 31628 raft_consensus.cc:348] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee5c16581d4e3f9417b4e3033989ef" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 34167 } } peers { permanent_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43879 } } peers { permanent_uuid: "4bcb4530bf394bccb98442f9854b0634" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35147 } }
I20260808 09:58:14.200557 31628 raft_consensus.cc:374] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:14.200598 31628 raft_consensus.cc:729] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bf375bf26ec4d5f95bd4cdb67e934cb, State: Initialized, Role: FOLLOWER
I20260808 09:58:14.200762 31628 consensus_queue.cc:260] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee5c16581d4e3f9417b4e3033989ef" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 34167 } } peers { permanent_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43879 } } peers { permanent_uuid: "4bcb4530bf394bccb98442f9854b0634" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35147 } }
I20260808 09:58:14.200910 31633 tablet_bootstrap.cc:492] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef: Bootstrap starting.
I20260808 09:58:14.201184 31628 ts_tablet_manager.cc:1428] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 09:58:14.201344 31604 heartbeater.cc:503] Master 127.24.71.254:33401 was elected leader, sending a full tablet report...
I20260808 09:58:14.201634 31633 tablet_bootstrap.cc:654] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:14.202056 31630 raft_consensus.cc:348] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee5c16581d4e3f9417b4e3033989ef" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 34167 } } peers { permanent_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43879 } } peers { permanent_uuid: "4bcb4530bf394bccb98442f9854b0634" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35147 } }
I20260808 09:58:14.202248 31630 raft_consensus.cc:374] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:14.202286 31630 raft_consensus.cc:729] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bcb4530bf394bccb98442f9854b0634, State: Initialized, Role: FOLLOWER
I20260808 09:58:14.202296 31633 log.cc:824] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:14.202430 31630 consensus_queue.cc:260] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee5c16581d4e3f9417b4e3033989ef" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 34167 } } peers { permanent_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43879 } } peers { permanent_uuid: "4bcb4530bf394bccb98442f9854b0634" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35147 } }
I20260808 09:58:14.202776 31630 ts_tablet_manager.cc:1428] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 09:58:14.202782 31408 heartbeater.cc:503] Master 127.24.71.254:33401 was elected leader, sending a full tablet report...
I20260808 09:58:14.203163 31633 tablet_bootstrap.cc:492] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef: No bootstrap required, opened a new log
I20260808 09:58:14.203233 31633 ts_tablet_manager.cc:1397] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 09:58:14.204777 31633 raft_consensus.cc:348] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee5c16581d4e3f9417b4e3033989ef" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 34167 } } peers { permanent_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43879 } } peers { permanent_uuid: "4bcb4530bf394bccb98442f9854b0634" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35147 } }
I20260808 09:58:14.204887 31633 raft_consensus.cc:374] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:14.204907 31633 raft_consensus.cc:729] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcee5c16581d4e3f9417b4e3033989ef, State: Initialized, Role: FOLLOWER
I20260808 09:58:14.204982 31633 consensus_queue.cc:260] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee5c16581d4e3f9417b4e3033989ef" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 34167 } } peers { permanent_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43879 } } peers { permanent_uuid: "4bcb4530bf394bccb98442f9854b0634" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35147 } }
I20260808 09:58:14.205176 31633 ts_tablet_manager.cc:1428] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 09:58:14.205243 31225 heartbeater.cc:503] Master 127.24.71.254:33401 was elected leader, sending a full tablet report...
W20260808 09:58:14.241999 31409 tablet.cc:2369] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 09:58:14.254426 31634 raft_consensus.cc:482] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:14.254567 31634 raft_consensus.cc:504] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee5c16581d4e3f9417b4e3033989ef" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 34167 } } peers { permanent_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43879 } } peers { permanent_uuid: "4bcb4530bf394bccb98442f9854b0634" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35147 } }
I20260808 09:58:14.254907 31634 leader_election.cc:288] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcee5c16581d4e3f9417b4e3033989ef (127.24.71.193:34167), 4bcb4530bf394bccb98442f9854b0634 (127.24.71.194:35147)
I20260808 09:58:14.257930 31624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.255233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:33589 (local address 127.24.71.194:35147)
0808 09:58:14.255322 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.255324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.255410 (+ 86us) server_negotiation.cc:407] Connection header received
0808 09:58:14.255529 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.255530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.255540 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.255611 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:14.255786 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.256243 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.257209 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.257576 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.257665 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.257675 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.257830 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.257864 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 09:58:14.257952 31640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.255118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:35147 (local address 127.24.71.195:33589)
0808 09:58:14.255318 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:14.255329 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:14.255432 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:14.255630 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:14.255630 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:14.255632 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:14.255714 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:14.255715 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.256330 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.256331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:14.257113 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:14.257115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.257665 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.257666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:14.257737 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.257741 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:58:14.257813 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 09:58:14.257853 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":22,"thread_start_us":124,"threads_started":1}
I20260808 09:58:14.258013 31622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.255229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:60511 (local address 127.24.71.193:34167)
0808 09:58:14.255281 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.255283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.255318 (+ 35us) server_negotiation.cc:407] Connection header received
0808 09:58:14.255468 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.255469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.255480 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.255539 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:14.255708 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.256201 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.257229 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.257595 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.257684 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.257694 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.257896 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.257936 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 09:58:14.258016 31607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.255118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:34167 (local address 127.24.71.195:60511)
0808 09:58:14.255238 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:14.255253 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:14.255338 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:14.255541 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:14.255542 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:14.255544 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:14.255629 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:14.255631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.256311 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.256312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:14.257114 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:14.257117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.257699 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.257700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:14.257797 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.257800 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:14.257876 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 09:58:14.257914 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"mutex_wait_us":27}
I20260808 09:58:14.258328 31346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c119aa1b7d1407db35f99596860aa46" candidate_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bcb4530bf394bccb98442f9854b0634" is_pre_election: true
I20260808 09:58:14.258473 31346 raft_consensus.cc:2454] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bf375bf26ec4d5f95bd4cdb67e934cb in term 0.
I20260808 09:58:14.258764 31437 leader_election.cc:302] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bcb4530bf394bccb98442f9854b0634, 6bf375bf26ec4d5f95bd4cdb67e934cb; no voters:
I20260808 09:58:14.258766 31159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c119aa1b7d1407db35f99596860aa46" candidate_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcee5c16581d4e3f9417b4e3033989ef" is_pre_election: true
I20260808 09:58:14.258899 31634 raft_consensus.cc:2781] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:58:14.258958 31634 raft_consensus.cc:482] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:58:14.258945 31159 raft_consensus.cc:2454] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bf375bf26ec4d5f95bd4cdb67e934cb in term 0.
I20260808 09:58:14.258999 31634 raft_consensus.cc:3037] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:14.259778 31634 raft_consensus.cc:504] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee5c16581d4e3f9417b4e3033989ef" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 34167 } } peers { permanent_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43879 } } peers { permanent_uuid: "4bcb4530bf394bccb98442f9854b0634" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35147 } }
I20260808 09:58:14.259931 31634 leader_election.cc:288] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [CANDIDATE]: Term 1 election: Requested vote from peers dcee5c16581d4e3f9417b4e3033989ef (127.24.71.193:34167), 4bcb4530bf394bccb98442f9854b0634 (127.24.71.194:35147)
I20260808 09:58:14.260140 31159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c119aa1b7d1407db35f99596860aa46" candidate_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcee5c16581d4e3f9417b4e3033989ef"
I20260808 09:58:14.260239 31159 raft_consensus.cc:3037] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:14.260208 31346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c119aa1b7d1407db35f99596860aa46" candidate_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bcb4530bf394bccb98442f9854b0634"
I20260808 09:58:14.260339 31346 raft_consensus.cc:3037] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:14.261242 31159 raft_consensus.cc:2454] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bf375bf26ec4d5f95bd4cdb67e934cb in term 1.
I20260808 09:58:14.261248 31346 raft_consensus.cc:2454] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bf375bf26ec4d5f95bd4cdb67e934cb in term 1.
I20260808 09:58:14.261448 31436 leader_election.cc:302] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bf375bf26ec4d5f95bd4cdb67e934cb, dcee5c16581d4e3f9417b4e3033989ef; no voters:
I20260808 09:58:14.261579 31634 raft_consensus.cc:2781] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:14.261775 31634 raft_consensus.cc:686] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [term 1 LEADER]: Becoming Leader. State: Replica: 6bf375bf26ec4d5f95bd4cdb67e934cb, State: Running, Role: LEADER
I20260808 09:58:14.261914 31634 consensus_queue.cc:237] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee5c16581d4e3f9417b4e3033989ef" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 34167 } } peers { permanent_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43879 } } peers { permanent_uuid: "4bcb4530bf394bccb98442f9854b0634" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35147 } }
I20260808 09:58:14.262745 30956 catalog_manager.cc:5495] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bf375bf26ec4d5f95bd4cdb67e934cb (127.24.71.195). New cstate: current_term: 1 leader_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee5c16581d4e3f9417b4e3033989ef" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bf375bf26ec4d5f95bd4cdb67e934cb" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bcb4530bf394bccb98442f9854b0634" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260808 09:58:14.284587 31623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.282316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45586 (local address 127.24.71.195:43879)
0808 09:58:14.282375 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.282377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.282385 (+ 8us) server_negotiation.cc:407] Connection header received
0808 09:58:14.282423 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.282424 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.282444 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.282518 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:14.282638 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.283096 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.283919 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:14.284099 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:14.284156 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:14.284292 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:14.284392 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:14.284455 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.284494 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.284511 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 09:58:14.286512 31346 raft_consensus.cc:1261] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634 [term 1 FOLLOWER]: Refusing update from remote peer 6bf375bf26ec4d5f95bd4cdb67e934cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:14.286512 31159 raft_consensus.cc:1261] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef [term 1 FOLLOWER]: Refusing update from remote peer 6bf375bf26ec4d5f95bd4cdb67e934cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:14.286901 31634 consensus_queue.cc:1035] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bcb4530bf394bccb98442f9854b0634" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:14.287070 31641 consensus_queue.cc:1035] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcee5c16581d4e3f9417b4e3033989ef" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:14.289999 31644 mvcc.cc:205] Tried to move back new op lower bound from 7316205954194595840 to 7316205954097553408. Current Snapshot: MvccSnapshot[applied={T|T < 7316205954194595840}]
I20260808 09:58:14.290139 31646 mvcc.cc:205] Tried to move back new op lower bound from 7316205954194595840 to 7316205954097553408. Current Snapshot: MvccSnapshot[applied={T|T < 7316205954194595840}]
I20260808 09:58:14.292431 30955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:14.292524 30955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:14.293295 30955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ee184e961ca84fbb98b72bca7dbe8834: Sending DeleteTablet for 3 replicas of tablet 9c119aa1b7d1407db35f99596860aa46
I20260808 09:58:14.293619 31506 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c119aa1b7d1407db35f99596860aa46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:14 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:46702
I20260808 09:58:14.293660 31128 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c119aa1b7d1407db35f99596860aa46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:14 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:43400
I20260808 09:58:14.293828 31312 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c119aa1b7d1407db35f99596860aa46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:14 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:49674
I20260808 09:58:14.293895 31666 tablet_replica.cc:330] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef: stopping tablet replica
I20260808 09:58:14.293991 31666 raft_consensus.cc:2229] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:14.294031 31667 tablet_replica.cc:330] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634: stopping tablet replica
I20260808 09:58:14.294121 31666 raft_consensus.cc:2258] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:14.294133 31667 raft_consensus.cc:2229] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:14.294222 31667 raft_consensus.cc:2258] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:14.294404 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 31043
I20260808 09:58:14.294593 31666 ts_tablet_manager.cc:1905] T 9c119aa1b7d1407db35f99596860aa46 P dcee5c16581d4e3f9417b4e3033989ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:14.299554 31663 tablet_replica.cc:330] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb: stopping tablet replica
I20260808 09:58:14.299674 31663 raft_consensus.cc:2229] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [term 1 LEADER]: Raft consensus shutting down.
I20260808 09:58:14.299796 31663 raft_consensus.cc:2258] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:14.301249 31663 ts_tablet_manager.cc:1905] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:14.301714 31667 ts_tablet_manager.cc:1905] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:14.303040 31663 ts_tablet_manager.cc:1918] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:14.303174 31663 log.cc:1196] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/9c119aa1b7d1407db35f99596860aa46
I20260808 09:58:14.303551 31667 ts_tablet_manager.cc:1918] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:14.303663 31663 ts_tablet_manager.cc:1939] T 9c119aa1b7d1407db35f99596860aa46 P 6bf375bf26ec4d5f95bd4cdb67e934cb: Deleting consensus metadata
I20260808 09:58:14.303697 31667 log.cc:1196] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/9c119aa1b7d1407db35f99596860aa46
I20260808 09:58:14.304018 31667 ts_tablet_manager.cc:1939] T 9c119aa1b7d1407db35f99596860aa46 P 4bcb4530bf394bccb98442f9854b0634: Deleting consensus metadata
I20260808 09:58:14.304245 30932 catalog_manager.cc:4841] TS 6bf375bf26ec4d5f95bd4cdb67e934cb (127.24.71.195:43879): tablet 9c119aa1b7d1407db35f99596860aa46 (table test-table [id=2cd47a85d30a4ee6b86be8eec73586c3]) successfully deleted
I20260808 09:58:14.304466 30932 catalog_manager.cc:4841] TS 4bcb4530bf394bccb98442f9854b0634 (127.24.71.194:35147): tablet 9c119aa1b7d1407db35f99596860aa46 (table test-table [id=2cd47a85d30a4ee6b86be8eec73586c3]) successfully deleted
W20260808 09:58:14.306389 30931 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:34167 (error 108)
I20260808 09:58:14.306689 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 31234
I20260808 09:58:14.311669 31620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.310089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:34167 (local address 127.0.0.1:34434)
0808 09:58:14.311581 (+ 1492us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:14.311626 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:34167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1467}
W20260808 09:58:14.321357 30931 catalog_manager.cc:4584] TS dcee5c16581d4e3f9417b4e3033989ef (127.24.71.193:34167): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9c119aa1b7d1407db35f99596860aa46: Network error: Client connection negotiation failed: client connection to 127.24.71.193:34167: connect: Connection refused (error 111)
I20260808 09:58:14.335034 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 31414
I20260808 09:58:14.344594 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 30907
2026-08-08T09:58:14Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2268 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T09:58:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:14Z Disabled control of system clock
I20260808 09:58:14.382193 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:46563
--webserver_interface=127.24.71.254
--webserver_port=0
--builtin_ntp_servers=127.24.71.212:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:46563
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 09:58:14.465065 31676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:14.465261 31676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:14.465282 31676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:14.466466 31676 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:14.466508 31676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:14.466522 31676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:14.466535 31676 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:14.466547 31676 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:14.467898 31676 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:46563
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:46563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:14.468170 31676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:14.468492 31676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:14.473321 31686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:14.473310 31682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:14.473513 31676 server_base.cc:1034] running on GCE node
W20260808 09:58:14.473306 31683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:14.473872 31676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:14.474155 31676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:14.475379 31676 hybrid_clock.cc:648] HybridClock initialized: now 1786183094475340 us; error 55 us; skew 500 ppm
I20260808 09:58:14.476747 31676 webserver.cc:460] Webserver started at http://127.24.71.254:36801/ using document root <none> and password file <none>
I20260808 09:58:14.476948 31676 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:14.476990 31676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:14.477079 31676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:14.478241 31676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "6425ed52f2e8413eb445e40fbac2ff64"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "01ba80d1611d1358cea57b20b897679f"
server_key_iv: "3f54effd24d52770e82b941c5715a29c"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.478628 31676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "6425ed52f2e8413eb445e40fbac2ff64"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "01ba80d1611d1358cea57b20b897679f"
server_key_iv: "3f54effd24d52770e82b941c5715a29c"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.480034 31676 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:14.480815 31696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:14.481009 31676 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:14.481101 31676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "6425ed52f2e8413eb445e40fbac2ff64"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "01ba80d1611d1358cea57b20b897679f"
server_key_iv: "3f54effd24d52770e82b941c5715a29c"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.481166 31676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:14.484753 31676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:14.484990 31676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:14.485097 31676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:14.489212 31676 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:46563
I20260808 09:58:14.489239 31764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:46563 every 8 connection(s)
I20260808 09:58:14.489604 31676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:14.490317 31766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:14.493330 31766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64: Bootstrap starting.
I20260808 09:58:14.493901 31766 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:14.494144 31766 log.cc:824] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:14.494786 31766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64: No bootstrap required, opened a new log
I20260808 09:58:14.496460 31766 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6425ed52f2e8413eb445e40fbac2ff64" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46563 } }
I20260808 09:58:14.496611 31766 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:14.496636 31766 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6425ed52f2e8413eb445e40fbac2ff64, State: Initialized, Role: FOLLOWER
I20260808 09:58:14.496797 31766 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6425ed52f2e8413eb445e40fbac2ff64" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46563 } }
I20260808 09:58:14.496904 31766 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:14.496893 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 31676
I20260808 09:58:14.496939 31766 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:14.496991 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:14.496999 31766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:14.497200 24863 external_mini_cluster.cc:1428] Setting key 2b90aafb4b373972e48f510a92bd4db5
I20260808 09:58:14.497766 31766 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6425ed52f2e8413eb445e40fbac2ff64" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46563 } }
I20260808 09:58:14.497895 31766 leader_election.cc:302] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6425ed52f2e8413eb445e40fbac2ff64; no voters:
I20260808 09:58:14.498068 31766 leader_election.cc:288] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:14.498095 31774 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:14.498306 31774 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [term 1 LEADER]: Becoming Leader. State: Replica: 6425ed52f2e8413eb445e40fbac2ff64, State: Running, Role: LEADER
I20260808 09:58:14.498445 31774 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6425ed52f2e8413eb445e40fbac2ff64" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46563 } }
I20260808 09:58:14.498327 31766 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:14.499490 31777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6425ed52f2e8413eb445e40fbac2ff64. Latest consensus state: current_term: 1 leader_uuid: "6425ed52f2e8413eb445e40fbac2ff64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6425ed52f2e8413eb445e40fbac2ff64" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46563 } } }
I20260808 09:58:14.499583 31777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:14.499814 31772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.497746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60606 (local address 127.24.71.254:46563)
0808 09:58:14.498064 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.498073 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.498107 (+ 34us) server_negotiation.cc:407] Connection header received
0808 09:58:14.498227 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.498234 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.498277 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.498429 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:14.499198 (+ 769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:14.499202 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:14.499203 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:14.499207 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:14.499259 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:14.499277 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:14.499339 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.499549 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.499609 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":138,"threads_started":1}
I20260808 09:58:14.499902 31786 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:14.500475 31776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6425ed52f2e8413eb445e40fbac2ff64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6425ed52f2e8413eb445e40fbac2ff64" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46563 } } }
I20260808 09:58:14.500560 31776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:14.500641 31786 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:14.502008 31786 catalog_manager.cc:1347] Generated new cluster ID: 591cae4422954957b45fd2d52aad4add
I20260808 09:58:14.502069 31786 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:14.528594 31786 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:14.528831 31786 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:14.532948 31786 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64: Generated new TSK 0
I20260808 09:58:14.533169 31786 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 09:58:14.541446 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:46563
--builtin_ntp_servers=127.24.71.212:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 09:58:14.626283 31798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:14.626500 31798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:14.626523 31798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:14.627772 31798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:14.627816 31798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:14.627842 31798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:14.629172 31798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:46563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:14.629384 31798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:14.629642 31798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:14.635010 31808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:14.635015 31810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:14.635299 31798 server_base.cc:1034] running on GCE node
W20260808 09:58:14.635123 31807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:14.635627 31798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:14.635838 31798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:14.636991 31798 hybrid_clock.cc:648] HybridClock initialized: now 1786183094636959 us; error 45 us; skew 500 ppm
I20260808 09:58:14.638286 31798 webserver.cc:460] Webserver started at http://127.24.71.193:46177/ using document root <none> and password file <none>
I20260808 09:58:14.638548 31798 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:14.638599 31798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:14.638778 31798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:14.639989 31798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "590a156ae41d4a1fb6c9191e8f79e708"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "adb519c580a784a72154a813d64942b6"
server_key_iv: "4500a1cb17e6b863a71c00d2504fc111"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.640357 31798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "590a156ae41d4a1fb6c9191e8f79e708"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "adb519c580a784a72154a813d64942b6"
server_key_iv: "4500a1cb17e6b863a71c00d2504fc111"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.641711 31798 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 09:58:14.642511 31817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:14.642710 31798 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:14.642818 31798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "590a156ae41d4a1fb6c9191e8f79e708"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "adb519c580a784a72154a813d64942b6"
server_key_iv: "4500a1cb17e6b863a71c00d2504fc111"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.642906 31798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:14.646296 31798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:14.646575 31798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:14.646720 31798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:14.646930 31798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:14.647240 31798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:14.647296 31798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:14.647336 31798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:14.647363 31798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:14.652786 31798 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:44097
I20260808 09:58:14.652881 31978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:44097 every 8 connection(s)
I20260808 09:58:14.653177 31798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 09:58:14.656384 31772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.653934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:33485 (local address 127.24.71.254:46563)
0808 09:58:14.653999 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.654001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.654234 (+ 233us) server_negotiation.cc:407] Connection header received
0808 09:58:14.654748 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.654749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.654759 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.654832 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:14.656096 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:14.656098 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:14.656098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:14.656103 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:14.656120 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:14.656125 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:14.656205 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.656292 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.656311 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 09:58:14.656594 31981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.653890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:46563 (local address 127.24.71.193:33485)
0808 09:58:14.654112 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:14.654146 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:14.654632 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:14.654902 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:14.654906 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:14.654916 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:14.655919 (+ 1003us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:14.655920 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:14.655947 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:14.655975 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:14.656202 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:14.656209 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:14.656213 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:58:14.656297 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 09:58:14.656360 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":98,"threads_started":1}
I20260808 09:58:14.657137 31979 heartbeater.cc:347] Connected to a master server at 127.24.71.254:46563
I20260808 09:58:14.657243 31979 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:14.657248 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 31798
I20260808 09:58:14.657342 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:58:14.657421 31979 heartbeater.cc:511] Master 127.24.71.254:46563 requested a full tablet report, sending...
I20260808 09:58:14.657568 24863 external_mini_cluster.cc:1428] Setting key 879f33efaa8dae8d0b7e8239fc63689c
I20260808 09:58:14.658013 31719 ts_manager.cc:194] Registered new tserver with Master: 590a156ae41d4a1fb6c9191e8f79e708 (127.24.71.193:44097)
I20260808 09:58:14.658659 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:46563
--builtin_ntp_servers=127.24.71.212:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 09:58:14.742347 31983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:14.742570 31983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:14.742594 31983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:14.743811 31983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:14.743853 31983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:14.743880 31983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:14.745216 31983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:46563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:14.745487 31983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:14.745814 31983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:14.750782 31988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:14.750792 31989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:14.750792 31991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:14.751157 31983 server_base.cc:1034] running on GCE node
I20260808 09:58:14.751441 31983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:14.751713 31983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:14.752853 31983 hybrid_clock.cc:648] HybridClock initialized: now 1786183094752839 us; error 33 us; skew 500 ppm
I20260808 09:58:14.754323 31983 webserver.cc:460] Webserver started at http://127.24.71.194:45941/ using document root <none> and password file <none>
I20260808 09:58:14.754616 31983 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:14.754688 31983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:14.754832 31983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:14.755986 31983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "7033f2fe43b844cd9e8203eabecc1e56"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "5a749b771632999ed6e2c478e5f68c92"
server_key_iv: "ea86920754e14825b10443b30c1ac473"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.756367 31983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "7033f2fe43b844cd9e8203eabecc1e56"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "5a749b771632999ed6e2c478e5f68c92"
server_key_iv: "ea86920754e14825b10443b30c1ac473"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.757694 31983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 09:58:14.758519 32002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:14.758690 31983 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:14.758797 31983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "7033f2fe43b844cd9e8203eabecc1e56"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "5a749b771632999ed6e2c478e5f68c92"
server_key_iv: "ea86920754e14825b10443b30c1ac473"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.758872 31983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:14.762326 31983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:14.762599 31983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:14.762739 31983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:14.762952 31983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:14.763257 31983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:14.763311 31983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:14.763351 31983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:14.763379 31983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:14.769099 31983 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:34571
I20260808 09:58:14.769135 32158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:34571 every 8 connection(s)
I20260808 09:58:14.769487 31983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:58:14.772548 31772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.770287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:52153 (local address 127.24.71.254:46563)
0808 09:58:14.770352 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.770354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.770603 (+ 249us) server_negotiation.cc:407] Connection header received
0808 09:58:14.771053 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.771055 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.771062 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.771121 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:14.772343 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:14.772344 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:14.772345 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:14.772349 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:14.772366 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:14.772371 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:14.772420 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.772483 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.772495 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 09:58:14.772771 32165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.770206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:46563 (local address 127.24.71.194:52153)
0808 09:58:14.770396 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:14.770448 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:14.770949 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:14.771172 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:14.771175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:14.771183 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:14.772196 (+ 1013us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:14.772197 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:14.772224 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:14.772256 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:14.772422 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:14.772424 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:14.772426 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 09:58:14.772476 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 09:58:14.772527 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":99,"threads_started":1}
I20260808 09:58:14.773301 32159 heartbeater.cc:347] Connected to a master server at 127.24.71.254:46563
I20260808 09:58:14.773391 32159 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:14.773518 32159 heartbeater.cc:511] Master 127.24.71.254:46563 requested a full tablet report, sending...
I20260808 09:58:14.773876 31719 ts_manager.cc:194] Registered new tserver with Master: 7033f2fe43b844cd9e8203eabecc1e56 (127.24.71.194:34571)
I20260808 09:58:14.774055 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 31983
I20260808 09:58:14.774161 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:58:14.774350 24863 external_mini_cluster.cc:1428] Setting key 705eb15d3c18b3b4fcc8ee52cfdca6b8
I20260808 09:58:14.775326 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:46563
--builtin_ntp_servers=127.24.71.212:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 09:58:14.858343 32166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:14.858553 32166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:14.858577 32166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:14.859850 32166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:14.859892 32166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:14.859920 32166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:14.861322 32166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:46563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:14.861598 32166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:14.861903 32166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:14.866883 32174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:14.866883 32179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:14.867080 32166 server_base.cc:1034] running on GCE node
W20260808 09:58:14.867208 32173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:14.867473 32166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:14.867674 32166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:14.868825 32166 hybrid_clock.cc:648] HybridClock initialized: now 1786183094868816 us; error 27 us; skew 500 ppm
I20260808 09:58:14.870164 32166 webserver.cc:460] Webserver started at http://127.24.71.195:42867/ using document root <none> and password file <none>
I20260808 09:58:14.870415 32166 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:14.870461 32166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:14.870623 32166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:14.871780 32166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "652cc6ee51d347b19c322d02d3d1d290"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "554d149e547459f3ac00398aed565a82"
server_key_iv: "5aafb844deafd22cc24a1c70fc64899d"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.872134 32166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "652cc6ee51d347b19c322d02d3d1d290"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "554d149e547459f3ac00398aed565a82"
server_key_iv: "5aafb844deafd22cc24a1c70fc64899d"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.873477 32166 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 09:58:14.874249 32187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:14.874457 32166 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 09:58:14.874540 32166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "652cc6ee51d347b19c322d02d3d1d290"
format_stamp: "Formatted at 2026-08-08 09:58:14 on dist-test-slave-gw5c"
server_key: "554d149e547459f3ac00398aed565a82"
server_key_iv: "5aafb844deafd22cc24a1c70fc64899d"
server_key_version: "encryptionkey@0"
I20260808 09:58:14.874595 32166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:14.877878 32166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:14.878086 32166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:14.878180 32166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:14.878326 32166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:14.878574 32166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:14.878604 32166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:14.878624 32166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:14.878638 32166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:14.884277 32166 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:35257
I20260808 09:58:14.884361 32342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:35257 every 8 connection(s)
I20260808 09:58:14.884727 32166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:58:14.887807 31772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.885481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:56859 (local address 127.24.71.254:46563)
0808 09:58:14.885526 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.885528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.885796 (+ 268us) server_negotiation.cc:407] Connection header received
0808 09:58:14.886299 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.886300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.886308 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.886360 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:14.887529 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:14.887530 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:14.887531 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:14.887536 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:14.887552 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:14.887557 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:14.887616 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.887718 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.887735 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 09:58:14.888005 32348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.885436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:46563 (local address 127.24.71.195:56859)
0808 09:58:14.885663 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:14.885695 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:14.886174 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:14.886426 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:14.886436 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:14.886444 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:14.887328 (+ 884us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:14.887328 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:14.887356 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:14.887382 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:14.887628 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:14.887632 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:14.887635 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:14.887735 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 09:58:14.887796 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":100,"threads_started":1}
I20260808 09:58:14.888540 32345 heartbeater.cc:347] Connected to a master server at 127.24.71.254:46563
I20260808 09:58:14.888617 32345 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:14.888727 32345 heartbeater.cc:511] Master 127.24.71.254:46563 requested a full tablet report, sending...
I20260808 09:58:14.889065 31719 ts_manager.cc:194] Registered new tserver with Master: 652cc6ee51d347b19c322d02d3d1d290 (127.24.71.195:35257)
I20260808 09:58:14.890837 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 32166
I20260808 09:58:14.890959 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:58:14.891147 24863 external_mini_cluster.cc:1428] Setting key 7f673eb47e5e73d9862a13a0c77c70a8
I20260808 09:58:14.892182 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 09:58:14.894572 31772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.893527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60614 (local address 127.24.71.254:46563)
0808 09:58:14.893569 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.893571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.893643 (+ 72us) server_negotiation.cc:407] Connection header received
0808 09:58:14.893697 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.893697 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.893702 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.893761 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:14.894399 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:14.894399 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:14.894400 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:14.894404 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:14.894418 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:14.894422 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:14.894476 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.894506 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.894517 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 09:58:14.896234 31719 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60614:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:58:14.897753 31719 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:58:14.901752 32359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.899992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:44097 (local address 127.0.0.1:35598)
0808 09:58:14.900453 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:14.900463 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:14.900532 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:14.900709 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:14.900715 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:14.900721 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:14.901207 (+ 486us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:14.901208 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:14.901221 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:14.901240 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:14.901569 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:14.901576 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:14.901580 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:58:14.901662 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 09:58:14.901678 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":103,"threads_started":1}
I20260808 09:58:14.901768 32363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.900259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35598 (local address 127.24.71.193:44097)
0808 09:58:14.900471 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.900475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.900527 (+ 52us) server_negotiation.cc:407] Connection header received
0808 09:58:14.900604 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.900605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.900613 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.900705 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:14.901406 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:14.901415 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:14.901416 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:14.901421 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:14.901459 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:14.901495 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:14.901575 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.901662 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.901681 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":95,"threads_started":1}
I20260808 09:58:14.902590 32358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.899957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:34571 (local address 127.0.0.1:37006)
0808 09:58:14.900111 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:14.900152 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:14.900211 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:14.901308 (+ 1097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:14.901309 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:14.901312 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:14.901736 (+ 424us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:14.901737 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:14.901745 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:14.901759 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:14.902435 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:14.902436 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:14.902437 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 09:58:14.902500 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 09:58:14.902515 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":69,"threads_started":1}
I20260808 09:58:14.902663 32360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.900150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37006 (local address 127.24.71.194:34571)
0808 09:58:14.900669 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.900672 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.900682 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:14.900705 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.900706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.900714 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.901504 (+ 790us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:14.902297 (+ 793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:14.902300 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:14.902300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:14.902303 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:14.902328 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:14.902338 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:14.902422 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.902546 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.902565 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":96,"threads_started":1}
I20260808 09:58:14.902606 31885 tablet_service.cc:1467] Processing CreateTablet for tablet 0831d1a63f664a5cbe2405885b287a46 (DEFAULT_TABLE table=test-table [id=62a32f3f5b8e4afbabd553521cf17cea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:14.903059 31885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0831d1a63f664a5cbe2405885b287a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:14.903673 32073 tablet_service.cc:1467] Processing CreateTablet for tablet 0831d1a63f664a5cbe2405885b287a46 (DEFAULT_TABLE table=test-table [id=62a32f3f5b8e4afbabd553521cf17cea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:14.903936 32357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.899967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:35257 (local address 127.0.0.1:42742)
0808 09:58:14.900352 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:14.900365 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:14.900419 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:14.902956 (+ 2537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:14.902957 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:14.902960 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:14.903449 (+ 489us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:14.903450 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:14.903458 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:14.903473 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:14.903774 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:14.903775 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:14.903776 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 09:58:14.903850 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 09:58:14.903865 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":90,"threads_started":1}
I20260808 09:58:14.903961 32361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:14.900187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42742 (local address 127.24.71.195:35257)
0808 09:58:14.902520 (+ 2333us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:14.902524 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:14.902536 (+ 12us) server_negotiation.cc:407] Connection header received
0808 09:58:14.902562 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:14.902564 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:14.902572 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:14.902652 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:14.903587 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:14.903595 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:14.903596 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:14.903601 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:14.903640 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:14.903668 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:14.903730 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:14.903860 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 09:58:14.903877 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2290,"thread_start_us":79,"threads_started":1}
I20260808 09:58:14.904062 32073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0831d1a63f664a5cbe2405885b287a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:14.904533 32254 tablet_service.cc:1467] Processing CreateTablet for tablet 0831d1a63f664a5cbe2405885b287a46 (DEFAULT_TABLE table=test-table [id=62a32f3f5b8e4afbabd553521cf17cea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:14.904798 32254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0831d1a63f664a5cbe2405885b287a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:14.906757 32364 tablet_bootstrap.cc:492] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708: Bootstrap starting.
I20260808 09:58:14.907279 32365 tablet_bootstrap.cc:492] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56: Bootstrap starting.
I20260808 09:58:14.907527 32364 tablet_bootstrap.cc:654] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:14.907917 32364 log.cc:824] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:14.907974 32365 tablet_bootstrap.cc:654] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:14.908241 32366 tablet_bootstrap.cc:492] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290: Bootstrap starting.
I20260808 09:58:14.908311 32365 log.cc:824] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:14.908836 32366 tablet_bootstrap.cc:654] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:14.909127 32364 tablet_bootstrap.cc:492] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708: No bootstrap required, opened a new log
I20260808 09:58:14.909169 32366 log.cc:824] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:14.909210 32364 ts_tablet_manager.cc:1397] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 09:58:14.909991 32366 tablet_bootstrap.cc:492] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290: No bootstrap required, opened a new log
I20260808 09:58:14.910084 32366 ts_tablet_manager.cc:1397] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:58:14.911933 32365 tablet_bootstrap.cc:492] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56: No bootstrap required, opened a new log
I20260808 09:58:14.912019 32365 ts_tablet_manager.cc:1397] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 09:58:14.912014 32364 raft_consensus.cc:348] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7033f2fe43b844cd9e8203eabecc1e56" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 34571 } } peers { permanent_uuid: "652cc6ee51d347b19c322d02d3d1d290" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35257 } } peers { permanent_uuid: "590a156ae41d4a1fb6c9191e8f79e708" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 44097 } }
I20260808 09:58:14.912212 32364 raft_consensus.cc:374] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:14.912487 32364 raft_consensus.cc:729] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590a156ae41d4a1fb6c9191e8f79e708, State: Initialized, Role: FOLLOWER
I20260808 09:58:14.912652 32364 consensus_queue.cc:260] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7033f2fe43b844cd9e8203eabecc1e56" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 34571 } } peers { permanent_uuid: "652cc6ee51d347b19c322d02d3d1d290" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35257 } } peers { permanent_uuid: "590a156ae41d4a1fb6c9191e8f79e708" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 44097 } }
I20260808 09:58:14.912958 32364 ts_tablet_manager.cc:1428] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260808 09:58:14.912910 32366 raft_consensus.cc:348] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7033f2fe43b844cd9e8203eabecc1e56" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 34571 } } peers { permanent_uuid: "652cc6ee51d347b19c322d02d3d1d290" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35257 } } peers { permanent_uuid: "590a156ae41d4a1fb6c9191e8f79e708" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 44097 } }
I20260808 09:58:14.913077 32366 raft_consensus.cc:374] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:14.913092 31979 heartbeater.cc:503] Master 127.24.71.254:46563 was elected leader, sending a full tablet report...
I20260808 09:58:14.913128 32366 raft_consensus.cc:729] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 652cc6ee51d347b19c322d02d3d1d290, State: Initialized, Role: FOLLOWER
I20260808 09:58:14.913259 32366 consensus_queue.cc:260] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7033f2fe43b844cd9e8203eabecc1e56" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 34571 } } peers { permanent_uuid: "652cc6ee51d347b19c322d02d3d1d290" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35257 } } peers { permanent_uuid: "590a156ae41d4a1fb6c9191e8f79e708" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 44097 } }
I20260808 09:58:14.913565 32345 heartbeater.cc:503] Master 127.24.71.254:46563 was elected leader, sending a full tablet report...
I20260808 09:58:14.913545 32366 ts_tablet_manager.cc:1428] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 09:58:14.914770 32365 raft_consensus.cc:348] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7033f2fe43b844cd9e8203eabecc1e56" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 34571 } } peers { permanent_uuid: "652cc6ee51d347b19c322d02d3d1d290" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35257 } } peers { permanent_uuid: "590a156ae41d4a1fb6c9191e8f79e708" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 44097 } }
I20260808 09:58:14.914950 32365 raft_consensus.cc:374] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:14.914994 32365 raft_consensus.cc:729] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7033f2fe43b844cd9e8203eabecc1e56, State: Initialized, Role: FOLLOWER
I20260808 09:58:14.915102 32365 consensus_queue.cc:260] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7033f2fe43b844cd9e8203eabecc1e56" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 34571 } } peers { permanent_uuid: "652cc6ee51d347b19c322d02d3d1d290" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35257 } } peers { permanent_uuid: "590a156ae41d4a1fb6c9191e8f79e708" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 44097 } }
I20260808 09:58:14.915349 32365 ts_tablet_manager.cc:1428] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 09:58:14.915447 32159 heartbeater.cc:503] Master 127.24.71.254:46563 was elected leader, sending a full tablet report...
W20260808 09:58:15.020040 32162 tablet.cc:2369] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 09:58:15.135308 32347 tablet.cc:2369] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 09:58:15.138382 32375 raft_consensus.cc:482] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:15.138554 32375 raft_consensus.cc:504] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7033f2fe43b844cd9e8203eabecc1e56" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 34571 } } peers { permanent_uuid: "652cc6ee51d347b19c322d02d3d1d290" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35257 } } peers { permanent_uuid: "590a156ae41d4a1fb6c9191e8f79e708" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 44097 } }
I20260808 09:58:15.139048 32375 leader_election.cc:288] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7033f2fe43b844cd9e8203eabecc1e56 (127.24.71.194:34571), 652cc6ee51d347b19c322d02d3d1d290 (127.24.71.195:35257)
I20260808 09:58:15.140447 31981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:15.139259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:34571 (local address 127.24.71.193:46549)
0808 09:58:15.139308 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:15.139320 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:15.139362 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:15.139586 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:15.139588 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:15.139590 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:15.140011 (+ 421us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:15.140012 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:15.140019 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:15.140031 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:15.140296 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:15.140297 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:15.140298 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 09:58:15.140361 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 09:58:15.140377 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 09:58:15.140452 32360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:15.139367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:46549 (local address 127.24.71.194:34571)
0808 09:58:15.139458 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:15.139461 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:15.139469 (+ 8us) server_negotiation.cc:407] Connection header received
0808 09:58:15.139497 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:15.139498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:15.139504 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:15.139562 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:15.140138 (+ 576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:15.140140 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:15.140141 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:15.140146 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:15.140165 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:15.140170 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:15.140298 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:15.140370 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 09:58:15.140385 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 09:58:15.140936 32361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:15.139361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:48451 (local address 127.24.71.195:35257)
0808 09:58:15.139450 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:15.139452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:15.139703 (+ 251us) server_negotiation.cc:407] Connection header received
0808 09:58:15.140005 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:15.140006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:15.140011 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:15.140086 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:15.140668 (+ 582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:15.140670 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:15.140670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:15.140676 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:15.140694 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:15.140699 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:15.140757 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:15.140872 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 09:58:15.140884 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 09:58:15.140973 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:15.139259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:35257 (local address 127.24.71.193:48451)
0808 09:58:15.139614 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:15.139624 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:15.139698 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:15.140094 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:15.140096 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:15.140098 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:15.140538 (+ 440us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:15.140539 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:15.140548 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:15.140561 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:15.140789 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:15.140790 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:15.140791 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 09:58:15.140868 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 09:58:15.140883 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":187,"thread_start_us":101,"threads_started":1}
I20260808 09:58:15.140936 32097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0831d1a63f664a5cbe2405885b287a46" candidate_uuid: "590a156ae41d4a1fb6c9191e8f79e708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7033f2fe43b844cd9e8203eabecc1e56" is_pre_election: true
I20260808 09:58:15.141100 32097 raft_consensus.cc:2454] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590a156ae41d4a1fb6c9191e8f79e708 in term 0.
I20260808 09:58:15.141351 31818 leader_election.cc:302] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590a156ae41d4a1fb6c9191e8f79e708, 7033f2fe43b844cd9e8203eabecc1e56; no voters:
I20260808 09:58:15.141332 32280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0831d1a63f664a5cbe2405885b287a46" candidate_uuid: "590a156ae41d4a1fb6c9191e8f79e708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "652cc6ee51d347b19c322d02d3d1d290" is_pre_election: true
I20260808 09:58:15.141475 32280 raft_consensus.cc:2454] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590a156ae41d4a1fb6c9191e8f79e708 in term 0.
I20260808 09:58:15.141490 32375 raft_consensus.cc:2781] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:58:15.141538 32375 raft_consensus.cc:482] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:58:15.141566 32375 raft_consensus.cc:3037] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:15.142395 32375 raft_consensus.cc:504] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7033f2fe43b844cd9e8203eabecc1e56" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 34571 } } peers { permanent_uuid: "652cc6ee51d347b19c322d02d3d1d290" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35257 } } peers { permanent_uuid: "590a156ae41d4a1fb6c9191e8f79e708" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 44097 } }
I20260808 09:58:15.142556 32375 leader_election.cc:288] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [CANDIDATE]: Term 1 election: Requested vote from peers 7033f2fe43b844cd9e8203eabecc1e56 (127.24.71.194:34571), 652cc6ee51d347b19c322d02d3d1d290 (127.24.71.195:35257)
I20260808 09:58:15.142692 32097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0831d1a63f664a5cbe2405885b287a46" candidate_uuid: "590a156ae41d4a1fb6c9191e8f79e708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7033f2fe43b844cd9e8203eabecc1e56"
I20260808 09:58:15.142707 32280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0831d1a63f664a5cbe2405885b287a46" candidate_uuid: "590a156ae41d4a1fb6c9191e8f79e708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "652cc6ee51d347b19c322d02d3d1d290"
I20260808 09:58:15.142778 32280 raft_consensus.cc:3037] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:15.142778 32097 raft_consensus.cc:3037] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:15.143723 32280 raft_consensus.cc:2454] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590a156ae41d4a1fb6c9191e8f79e708 in term 1.
I20260808 09:58:15.143723 32097 raft_consensus.cc:2454] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590a156ae41d4a1fb6c9191e8f79e708 in term 1.
I20260808 09:58:15.143940 31822 leader_election.cc:302] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590a156ae41d4a1fb6c9191e8f79e708, 652cc6ee51d347b19c322d02d3d1d290; no voters:
I20260808 09:58:15.144045 32375 raft_consensus.cc:2781] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:15.144191 32375 raft_consensus.cc:686] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [term 1 LEADER]: Becoming Leader. State: Replica: 590a156ae41d4a1fb6c9191e8f79e708, State: Running, Role: LEADER
I20260808 09:58:15.144311 32375 consensus_queue.cc:237] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7033f2fe43b844cd9e8203eabecc1e56" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 34571 } } peers { permanent_uuid: "652cc6ee51d347b19c322d02d3d1d290" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35257 } } peers { permanent_uuid: "590a156ae41d4a1fb6c9191e8f79e708" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 44097 } }
I20260808 09:58:15.145241 31718 catalog_manager.cc:5495] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 reported cstate change: term changed from 0 to 1, leader changed from <none> to 590a156ae41d4a1fb6c9191e8f79e708 (127.24.71.193). New cstate: current_term: 1 leader_uuid: "590a156ae41d4a1fb6c9191e8f79e708" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7033f2fe43b844cd9e8203eabecc1e56" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 34571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "652cc6ee51d347b19c322d02d3d1d290" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590a156ae41d4a1fb6c9191e8f79e708" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 44097 } health_report { overall_health: HEALTHY } } }
W20260808 09:58:15.156997 31980 tablet.cc:2369] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 09:58:15.186792 32363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:15.185855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35610 (local address 127.24.71.193:44097)
0808 09:58:15.185922 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:15.185924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:15.185933 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:15.185970 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:15.185971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:15.185984 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:15.186035 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:15.186561 (+ 526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:15.186562 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:15.186562 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:15.186566 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:15.186581 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:15.186585 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:15.186637 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:15.186669 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 09:58:15.186680 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 09:58:15.188694 32280 raft_consensus.cc:1261] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290 [term 1 FOLLOWER]: Refusing update from remote peer 590a156ae41d4a1fb6c9191e8f79e708: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:15.188692 32097 raft_consensus.cc:1261] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56 [term 1 FOLLOWER]: Refusing update from remote peer 590a156ae41d4a1fb6c9191e8f79e708: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:15.189082 32380 consensus_queue.cc:1035] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [LEADER]: Connected to new peer: Peer: permanent_uuid: "652cc6ee51d347b19c322d02d3d1d290" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:15.189216 32375 consensus_queue.cc:1035] T 0831d1a63f664a5cbe2405885b287a46 P 590a156ae41d4a1fb6c9191e8f79e708 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7033f2fe43b844cd9e8203eabecc1e56" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 34571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:15.192667 32386 mvcc.cc:205] Tried to move back new op lower bound from 7316205957890215936 to 7316205957711564800. Current Snapshot: MvccSnapshot[applied={T|T < 7316205957890215936 or (T in {7316205957890215936})}]
I20260808 09:58:15.193595 32389 mvcc.cc:205] Tried to move back new op lower bound from 7316205957890215936 to 7316205957711564800. Current Snapshot: MvccSnapshot[applied={T|T < 7316205957890215936 or (T in {7316205957890215936})}]
I20260808 09:58:15.194125 31718 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:15.194249 31718 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:15.195081 31718 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6425ed52f2e8413eb445e40fbac2ff64: Sending DeleteTablet for 3 replicas of tablet 0831d1a63f664a5cbe2405885b287a46
I20260808 09:58:15.195461 32073 tablet_service.cc:1514] Processing DeleteTablet for tablet 0831d1a63f664a5cbe2405885b287a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:15 UTC) from {username='slave'} at 127.0.0.1:37006
I20260808 09:58:15.195475 31885 tablet_service.cc:1514] Processing DeleteTablet for tablet 0831d1a63f664a5cbe2405885b287a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:15 UTC) from {username='slave'} at 127.0.0.1:35598
I20260808 09:58:15.195628 32254 tablet_service.cc:1514] Processing DeleteTablet for tablet 0831d1a63f664a5cbe2405885b287a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:15 UTC) from {username='slave'} at 127.0.0.1:42742
I20260808 09:58:15.195845 32402 tablet_replica.cc:330] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290: stopping tablet replica
I20260808 09:58:15.195880 32398 tablet_replica.cc:330] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56: stopping tablet replica
I20260808 09:58:15.195927 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 31798
I20260808 09:58:15.195955 32402 raft_consensus.cc:2229] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:15.195981 32398 raft_consensus.cc:2229] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:15.196049 32402 raft_consensus.cc:2258] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:15.196080 32398 raft_consensus.cc:2258] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:15.203991 32402 ts_tablet_manager.cc:1905] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:15.206097 32402 ts_tablet_manager.cc:1918] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:15.206182 32402 log.cc:1196] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/0831d1a63f664a5cbe2405885b287a46
I20260808 09:58:15.206430 32402 ts_tablet_manager.cc:1939] T 0831d1a63f664a5cbe2405885b287a46 P 652cc6ee51d347b19c322d02d3d1d290: Deleting consensus metadata
I20260808 09:58:15.207208 31700 catalog_manager.cc:4841] TS 652cc6ee51d347b19c322d02d3d1d290 (127.24.71.195:35257): tablet 0831d1a63f664a5cbe2405885b287a46 (table test-table [id=62a32f3f5b8e4afbabd553521cf17cea]) successfully deleted
I20260808 09:58:15.208017 32398 ts_tablet_manager.cc:1905] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:15.210026 32398 ts_tablet_manager.cc:1918] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:15.210119 32398 log.cc:1196] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/0831d1a63f664a5cbe2405885b287a46
I20260808 09:58:15.210417 32398 ts_tablet_manager.cc:1939] T 0831d1a63f664a5cbe2405885b287a46 P 7033f2fe43b844cd9e8203eabecc1e56: Deleting consensus metadata
I20260808 09:58:15.210978 31697 catalog_manager.cc:4841] TS 7033f2fe43b844cd9e8203eabecc1e56 (127.24.71.194:34571): tablet 0831d1a63f664a5cbe2405885b287a46 (table test-table [id=62a32f3f5b8e4afbabd553521cf17cea]) successfully deleted
W20260808 09:58:15.212729 31698 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:44097 (error 108)
I20260808 09:58:15.213006 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 31983
I20260808 09:58:15.213308 32357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:15.213173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:44097 (local address 127.0.0.1:35614)
0808 09:58:15.213227 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:15.213267 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:44097: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 09:58:15.213440 31698 catalog_manager.cc:4584] TS 590a156ae41d4a1fb6c9191e8f79e708 (127.24.71.193:44097): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0831d1a63f664a5cbe2405885b287a46: Network error: Client connection negotiation failed: client connection to 127.24.71.193:44097: connect: Connection refused (error 111)
I20260808 09:58:15.226883 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 32166
I20260808 09:58:15.238672 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 31676
2026-08-08T09:58:15Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (888 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 09:58:15.262954 24863 mini_oidc.cc:152] Starting JWKS server
I20260808 09:58:15.264247 24863 webserver.cc:460] Webserver started at https://127.0.0.1:35643/ using document root <none> and password file <none>
I20260808 09:58:15.264381 24863 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 09:58:15.264578 24863 webserver.cc:460] Webserver started at http://127.0.0.1:46789/ using document root <none> and password file <none>
2026-08-08T09:58:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:15Z Disabled control of system clock
I20260808 09:58:15.273686 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:39365
--webserver_interface=127.24.71.254
--webserver_port=0
--builtin_ntp_servers=127.24.71.212:38193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:39365
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35643/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/testchainca.cert with env {}
W20260808 09:58:15.356051 32414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:15.356249 32414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:15.356271 32414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:15.357450 32414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:15.357491 32414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:15.357503 32414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:15.357517 32414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:15.357528 32414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 09:58:15.357589 32414 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 09:58:15.357604 32414 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35643/jwks.json
I20260808 09:58:15.359225 32414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:39365
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:39365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35643/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:15.359510 32414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:15.359735 32414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:15.364768 32420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:15.364780 32423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:15.364780 32421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:15.365088 32414 server_base.cc:1034] running on GCE node
I20260808 09:58:15.365383 32414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:15.365670 32414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:15.366814 32414 hybrid_clock.cc:648] HybridClock initialized: now 1786183095366796 us; error 43 us; skew 500 ppm
I20260808 09:58:15.368242 32414 webserver.cc:460] Webserver started at http://127.24.71.254:39237/ using document root <none> and password file <none>
I20260808 09:58:15.368538 32414 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:15.368616 32414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:15.368806 32414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:15.369869 32414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "67b470786dbb49788bad585d9ff65ce0"
format_stamp: "Formatted at 2026-08-08 09:58:15 on dist-test-slave-gw5c"
server_key: "2f4b4e22c6db3c3c9a2b10a17d9e6aa0"
server_key_iv: "f8bc905a09e20ec05ddbc59df573d96f"
server_key_version: "encryptionkey@0"
I20260808 09:58:15.370255 32414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "67b470786dbb49788bad585d9ff65ce0"
format_stamp: "Formatted at 2026-08-08 09:58:15 on dist-test-slave-gw5c"
server_key: "2f4b4e22c6db3c3c9a2b10a17d9e6aa0"
server_key_iv: "f8bc905a09e20ec05ddbc59df573d96f"
server_key_version: "encryptionkey@0"
I20260808 09:58:15.374819 32414 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 09:58:15.376138 32435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:15.376549 32414 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:15.376642 32414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "67b470786dbb49788bad585d9ff65ce0"
format_stamp: "Formatted at 2026-08-08 09:58:15 on dist-test-slave-gw5c"
server_key: "2f4b4e22c6db3c3c9a2b10a17d9e6aa0"
server_key_iv: "f8bc905a09e20ec05ddbc59df573d96f"
server_key_version: "encryptionkey@0"
I20260808 09:58:15.376727 32414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:15.386518 32414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:15.386780 32414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:15.386884 32414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:15.391038 32414 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:39365
I20260808 09:58:15.391070 32505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:39365 every 8 connection(s)
I20260808 09:58:15.391508 32414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:15.392510 32508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:15.395018 32508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0: Bootstrap starting.
I20260808 09:58:15.395675 32508 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:15.395995 32508 log.cc:824] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:15.396708 32508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0: No bootstrap required, opened a new log
I20260808 09:58:15.398352 32508 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b470786dbb49788bad585d9ff65ce0" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 39365 } }
I20260808 09:58:15.398535 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 32414
I20260808 09:58:15.398553 32508 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:15.398593 32508 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67b470786dbb49788bad585d9ff65ce0, State: Initialized, Role: FOLLOWER
I20260808 09:58:15.398627 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:15.398756 32508 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b470786dbb49788bad585d9ff65ce0" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 39365 } }
I20260808 09:58:15.398826 24863 external_mini_cluster.cc:1428] Setting key 05616408ecf11616b0013a8b57b4408a
I20260808 09:58:15.398842 32508 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:15.398877 32508 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:15.398928 32508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:15.399742 32508 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b470786dbb49788bad585d9ff65ce0" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 39365 } }
I20260808 09:58:15.399853 32508 leader_election.cc:302] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67b470786dbb49788bad585d9ff65ce0; no voters:
I20260808 09:58:15.400010 32508 leader_election.cc:288] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:15.400053 32515 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:15.400213 32515 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [term 1 LEADER]: Becoming Leader. State: Replica: 67b470786dbb49788bad585d9ff65ce0, State: Running, Role: LEADER
I20260808 09:58:15.400283 32508 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:15.400337 32515 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b470786dbb49788bad585d9ff65ce0" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 39365 } }
I20260808 09:58:15.400720 32515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67b470786dbb49788bad585d9ff65ce0. Latest consensus state: current_term: 1 leader_uuid: "67b470786dbb49788bad585d9ff65ce0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b470786dbb49788bad585d9ff65ce0" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 39365 } } }
I20260808 09:58:15.400803 32515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:15.400961 32517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67b470786dbb49788bad585d9ff65ce0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b470786dbb49788bad585d9ff65ce0" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 39365 } } }
I20260808 09:58:15.401022 32517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:15.401350 32525 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:15.401890 32525 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:15.403591 32525 catalog_manager.cc:1347] Generated new cluster ID: aa5fd5c1050643f2be7e9daeac072ec2
I20260808 09:58:15.403647 32525 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:15.405346 32512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:15.399339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50286 (local address 127.24.71.254:39365)
0808 09:58:15.399611 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:15.399620 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:15.399656 (+ 36us) server_negotiation.cc:407] Connection header received
0808 09:58:15.399781 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:15.399789 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:15.399863 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:15.400017 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:15.400404 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.402129 (+ 1725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.403099 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.403727 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.403852 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:15.404573 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:15.404576 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:15.404577 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:15.404806 (+ 229us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:15.404849 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:15.404865 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:15.404938 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:15.405030 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 09:58:15.405110 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":140,"threads_started":1}
I20260808 09:58:15.406324 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 09:58:15.412982 32525 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:15.413702 32525 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:15.424199 32525 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67b470786dbb49788bad585d9ff65ce0: Generated new TSK 0
I20260808 09:58:15.424487 32525 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 09:58:15.455101 32558 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 09:58:15.455264 32558 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260808 09:58:15.456100 32553 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:15.439197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:39365 (local address 127.0.0.1:50296)
0808 09:58:15.439416 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:15.439428 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:15.439498 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:15.439689 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:15.439689 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:15.439691 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 09:58:15.439751 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:15.439753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.440719 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.440720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:15.441317 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:15.441319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.441858 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.441859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:15.441906 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:15.441927 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 09:58:15.455481 (+ 13554us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35643/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 09:58:15.455595 (+ 114us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.71.254:39365: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35643/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":110,"threads_started":1}
I20260808 09:58:15.456437 32512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:15.439289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50296 (local address 127.24.71.254:39365)
0808 09:58:15.439344 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:15.439347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:15.439488 (+ 141us) server_negotiation.cc:407] Connection header received
0808 09:58:15.439581 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:15.439582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:15.439595 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:15.439688 (+ 93us) server_negotiation.cc:226] Negotiated authn=JWT
0808 09:58:15.439822 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.440609 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.441430 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.441758 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.441841 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:15.442054 (+ 213us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 09:58:15.455262 (+ 13208us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35643/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 09:58:15.456369 (+ 1107us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50296: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35643/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":29}
W20260808 09:58:15.456492 32512 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50296: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35643/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.24.71.254:39365: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35643/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 09:58:15.456686 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 32414
2026-08-08T09:58:15Z chronyd exiting
I20260808 09:58:15.502315 24863 test_util.cc:175] -----------------------------------------------
I20260808 09:58:15.502418 24863 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786183068256695-24863-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (240 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 09:58:15.503357 24863 mini_oidc.cc:152] Starting JWKS server
I20260808 09:58:15.504218 24863 webserver.cc:460] Webserver started at https://127.0.0.1:41845/ using document root <none> and password file <none>
I20260808 09:58:15.504276 24863 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 09:58:15.504465 24863 webserver.cc:460] Webserver started at http://127.0.0.1:42509/ using document root <none> and password file <none>
2026-08-08T09:58:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:15Z Disabled control of system clock
I20260808 09:58:15.514093 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:37517
--webserver_interface=127.24.71.254
--webserver_port=0
--builtin_ntp_servers=127.24.71.212:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:37517
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41845/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/testchainca.cert with env {}
W20260808 09:58:15.597391 32565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:15.597610 32565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:15.597633 32565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:15.598832 32565 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:15.598881 32565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:15.598893 32565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:15.598907 32565 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:15.598919 32565 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 09:58:15.598932 32565 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 09:58:15.598943 32565 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41845/jwks.json
I20260808 09:58:15.600495 32565 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:37517
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:37517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41845/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:15.600697 32565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:15.600869 32565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:15.606076 32574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:15.606079 32576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:15.606071 32573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:15.606385 32565 server_base.cc:1034] running on GCE node
I20260808 09:58:15.606624 32565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:15.606920 32565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:15.608073 32565 hybrid_clock.cc:648] HybridClock initialized: now 1786183095608061 us; error 28 us; skew 500 ppm
I20260808 09:58:15.609400 32565 webserver.cc:460] Webserver started at http://127.24.71.254:40455/ using document root <none> and password file <none>
I20260808 09:58:15.609668 32565 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:15.609714 32565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:15.609889 32565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:15.610967 32565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "47ac33c5e5b949d1b48be7f338dcf1bf"
format_stamp: "Formatted at 2026-08-08 09:58:15 on dist-test-slave-gw5c"
server_key: "971e1933e799c783f3ba334eee96a6c8"
server_key_iv: "8abb29116f047ac9d0d2112a28baf501"
server_key_version: "encryptionkey@0"
I20260808 09:58:15.611348 32565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "47ac33c5e5b949d1b48be7f338dcf1bf"
format_stamp: "Formatted at 2026-08-08 09:58:15 on dist-test-slave-gw5c"
server_key: "971e1933e799c783f3ba334eee96a6c8"
server_key_iv: "8abb29116f047ac9d0d2112a28baf501"
server_key_version: "encryptionkey@0"
I20260808 09:58:15.612712 32565 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:15.613487 32583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:15.613669 32565 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 09:58:15.613777 32565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "47ac33c5e5b949d1b48be7f338dcf1bf"
format_stamp: "Formatted at 2026-08-08 09:58:15 on dist-test-slave-gw5c"
server_key: "971e1933e799c783f3ba334eee96a6c8"
server_key_iv: "8abb29116f047ac9d0d2112a28baf501"
server_key_version: "encryptionkey@0"
I20260808 09:58:15.613865 32565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:15.635635 32565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:15.636003 32565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:15.636173 32565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:15.640897 32565 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:37517
I20260808 09:58:15.640941 32659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:37517 every 8 connection(s)
I20260808 09:58:15.641302 32565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:15.642014 32661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:15.644972 32661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf: Bootstrap starting.
I20260808 09:58:15.645607 32661 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:15.645912 32661 log.cc:824] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:15.646663 32661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf: No bootstrap required, opened a new log
I20260808 09:58:15.648288 32661 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47ac33c5e5b949d1b48be7f338dcf1bf" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37517 } }
I20260808 09:58:15.648443 32661 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:15.648469 32661 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ac33c5e5b949d1b48be7f338dcf1bf, State: Initialized, Role: FOLLOWER
I20260808 09:58:15.648631 32661 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47ac33c5e5b949d1b48be7f338dcf1bf" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37517 } }
I20260808 09:58:15.648697 32661 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:15.648720 32661 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:15.648747 32661 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:15.649324 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 32565
I20260808 09:58:15.649372 32661 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47ac33c5e5b949d1b48be7f338dcf1bf" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37517 } }
I20260808 09:58:15.649438 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:15.649510 32661 leader_election.cc:302] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47ac33c5e5b949d1b48be7f338dcf1bf; no voters:
I20260808 09:58:15.649708 32661 leader_election.cc:288] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:15.649715 24863 external_mini_cluster.cc:1428] Setting key bd343319cdb3eda9d9901964c4bc8ce2
I20260808 09:58:15.649741 32666 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:15.649857 32666 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [term 1 LEADER]: Becoming Leader. State: Replica: 47ac33c5e5b949d1b48be7f338dcf1bf, State: Running, Role: LEADER
I20260808 09:58:15.649959 32666 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47ac33c5e5b949d1b48be7f338dcf1bf" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37517 } }
I20260808 09:58:15.650015 32661 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:15.650275 32666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47ac33c5e5b949d1b48be7f338dcf1bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47ac33c5e5b949d1b48be7f338dcf1bf" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37517 } } }
I20260808 09:58:15.650348 32666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:15.650485 32666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47ac33c5e5b949d1b48be7f338dcf1bf. Latest consensus state: current_term: 1 leader_uuid: "47ac33c5e5b949d1b48be7f338dcf1bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47ac33c5e5b949d1b48be7f338dcf1bf" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37517 } } }
I20260808 09:58:15.650553 32666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:15.650846 32673 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:15.651477 32673 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:15.653342 32673 catalog_manager.cc:1347] Generated new cluster ID: 06d52710ac854a63ab64480580a7152c
I20260808 09:58:15.653404 32673 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:15.656635 32675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:15.650443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46350 (local address 127.24.71.254:37517)
0808 09:58:15.650719 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:15.650731 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:15.650767 (+ 36us) server_negotiation.cc:407] Connection header received
0808 09:58:15.650895 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:15.650913 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:15.650988 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:15.651416 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:15.651523 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.653029 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.654082 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.654575 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.654757 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:15.655832 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:15.655836 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:15.655837 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:15.656051 (+ 214us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:15.656090 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:15.656102 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:15.656198 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:15.656292 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 09:58:15.656385 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":141,"threads_started":1}
I20260808 09:58:15.657724 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 09:58:15.662598 32673 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:15.663273 32673 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:15.671792 32673 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47ac33c5e5b949d1b48be7f338dcf1bf: Generated new TSK 0
I20260808 09:58:15.672035 32673 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 09:58:15.695101 32703 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 09:58:15.695215 32703 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 09:58:15.695673 32675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:15.679447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46362 (local address 127.24.71.254:37517)
0808 09:58:15.679513 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:15.679516 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:15.679666 (+ 150us) server_negotiation.cc:407] Connection header received
0808 09:58:15.679748 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:15.679749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:15.679764 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:15.679841 (+ 77us) server_negotiation.cc:226] Negotiated authn=JWT
0808 09:58:15.680012 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.680606 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.681779 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.682024 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.682095 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:15.682327 (+ 232us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 09:58:15.695437 (+ 13110us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41845/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 09:58:15.695613 (+ 176us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46362: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41845/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 09:58:15.695760 32675 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46362: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41845/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 09:58:15.695981 32702 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:15.679348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37517 (local address 127.0.0.1:46362)
0808 09:58:15.679569 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:15.679586 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:15.679670 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:15.679863 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:15.679864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:15.679867 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0808 09:58:15.679936 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:15.679939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.680706 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.680707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:15.681676 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:15.681679 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.682122 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.682123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:15.682186 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:15.682192 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 09:58:15.695591 (+ 13399us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41845/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 09:58:15.695751 (+ 160us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.71.254:37517: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41845/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":128,"threads_started":1}
I20260808 09:58:15.696344 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 32565
2026-08-08T09:58:15Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (236 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 09:58:15.739988 24863 mini_oidc.cc:152] Starting JWKS server
I20260808 09:58:15.740654 24863 webserver.cc:460] Webserver started at https://127.0.0.1:41931/ using document root <none> and password file <none>
I20260808 09:58:15.740727 24863 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 09:58:15.740885 24863 webserver.cc:460] Webserver started at http://127.0.0.1:45685/ using document root <none> and password file <none>
2026-08-08T09:58:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:15Z Disabled control of system clock
I20260808 09:58:15.749938 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:40617
--webserver_interface=127.24.71.254
--webserver_port=0
--builtin_ntp_servers=127.24.71.212:46233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:40617
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41931/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 09:58:15.832490 32710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:15.832710 32710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:15.832731 32710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:15.833844 32710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:15.833880 32710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:15.833941 32710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:15.833963 32710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:15.833982 32710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 09:58:15.834014 32710 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 09:58:15.834038 32710 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41931/jwks.json
I20260808 09:58:15.835372 32710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:46233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:40617
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:40617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41931/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:15.835602 32710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:15.835836 32710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:15.840715 32721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:15.840705 32724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:15.840705 32719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:15.841058 32710 server_base.cc:1034] running on GCE node
I20260808 09:58:15.841333 32710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:15.841620 32710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:15.842785 32710 hybrid_clock.cc:648] HybridClock initialized: now 1786183095842775 us; error 43 us; skew 500 ppm
I20260808 09:58:15.844280 32710 webserver.cc:460] Webserver started at http://127.24.71.254:40731/ using document root <none> and password file <none>
I20260808 09:58:15.844527 32710 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:15.844597 32710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:15.844754 32710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:15.845853 32710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "86e2954afe104779a26f1f6bda3f38e0"
format_stamp: "Formatted at 2026-08-08 09:58:15 on dist-test-slave-gw5c"
server_key: "2074d06b80d7a1dddfe4e46f9fe5a446"
server_key_iv: "75993b1cb3c09bcf4f66b1e49bb499e0"
server_key_version: "encryptionkey@0"
I20260808 09:58:15.846233 32710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "86e2954afe104779a26f1f6bda3f38e0"
format_stamp: "Formatted at 2026-08-08 09:58:15 on dist-test-slave-gw5c"
server_key: "2074d06b80d7a1dddfe4e46f9fe5a446"
server_key_iv: "75993b1cb3c09bcf4f66b1e49bb499e0"
server_key_version: "encryptionkey@0"
I20260808 09:58:15.847615 32710 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:15.848362 32734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:15.848533 32710 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:15.848642 32710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "86e2954afe104779a26f1f6bda3f38e0"
format_stamp: "Formatted at 2026-08-08 09:58:15 on dist-test-slave-gw5c"
server_key: "2074d06b80d7a1dddfe4e46f9fe5a446"
server_key_iv: "75993b1cb3c09bcf4f66b1e49bb499e0"
server_key_version: "encryptionkey@0"
I20260808 09:58:15.848717 32710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:15.871956 32710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:15.872335 32710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:15.872505 32710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:15.876955 32710 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:40617
I20260808 09:58:15.876994 343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:40617 every 8 connection(s)
I20260808 09:58:15.877381 32710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:15.878090 344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:15.880990 344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0: Bootstrap starting.
I20260808 09:58:15.881650 344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:15.881961 344 log.cc:824] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:15.882797 344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0: No bootstrap required, opened a new log
I20260808 09:58:15.884545 344 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86e2954afe104779a26f1f6bda3f38e0" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40617 } }
I20260808 09:58:15.884770 344 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:15.884819 344 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e2954afe104779a26f1f6bda3f38e0, State: Initialized, Role: FOLLOWER
I20260808 09:58:15.884837 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 32710
I20260808 09:58:15.884940 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:15.884992 344 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86e2954afe104779a26f1f6bda3f38e0" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40617 } }
I20260808 09:58:15.885087 344 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:15.885120 344 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:15.885149 24863 external_mini_cluster.cc:1428] Setting key 0a5efa41aafd8bf7f5cece45b5cf8e6c
I20260808 09:58:15.885172 344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:15.886020 344 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86e2954afe104779a26f1f6bda3f38e0" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40617 } }
I20260808 09:58:15.886116 344 leader_election.cc:302] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86e2954afe104779a26f1f6bda3f38e0; no voters:
I20260808 09:58:15.886334 344 leader_election.cc:288] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:15.886384 351 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:15.886652 351 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [term 1 LEADER]: Becoming Leader. State: Replica: 86e2954afe104779a26f1f6bda3f38e0, State: Running, Role: LEADER
I20260808 09:58:15.886771 344 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:15.886798 351 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86e2954afe104779a26f1f6bda3f38e0" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40617 } }
I20260808 09:58:15.887141 353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86e2954afe104779a26f1f6bda3f38e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86e2954afe104779a26f1f6bda3f38e0" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40617 } } }
I20260808 09:58:15.887131 351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86e2954afe104779a26f1f6bda3f38e0. Latest consensus state: current_term: 1 leader_uuid: "86e2954afe104779a26f1f6bda3f38e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86e2954afe104779a26f1f6bda3f38e0" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40617 } } }
I20260808 09:58:15.887228 353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:15.887236 351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:15.887574 357 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:15.888127 357 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:15.891826 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:15.885731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46988 (local address 127.24.71.254:40617)
0808 09:58:15.885993 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:15.886001 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:15.886027 (+ 26us) server_negotiation.cc:407] Connection header received
0808 09:58:15.886156 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:15.886163 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:15.886240 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:15.886409 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:15.886725 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.888603 (+ 1878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.889692 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.890209 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.890303 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:15.891024 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:15.891027 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:15.891027 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:15.891194 (+ 167us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:15.891227 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:15.891239 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:15.891293 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:15.891550 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 09:58:15.891640 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":128,"threads_started":1}
I20260808 09:58:15.892908 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 09:58:15.896517 357 catalog_manager.cc:1347] Generated new cluster ID: 62cea357d6094a73a099e4393811bb2d
I20260808 09:58:15.896584 357 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:15.910271 357 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:15.910854 357 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:15.922354 357 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86e2954afe104779a26f1f6bda3f38e0: Generated new TSK 0
I20260808 09:58:15.922597 357 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 09:58:15.934932 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:15.930277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46996 (local address 127.24.71.254:40617)
0808 09:58:15.930341 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:15.930343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:15.930425 (+ 82us) server_negotiation.cc:407] Connection header received
0808 09:58:15.930482 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:15.930483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:15.930496 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:15.930578 (+ 82us) server_negotiation.cc:226] Negotiated authn=JWT
0808 09:58:15.930688 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.931522 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.932417 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.932731 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.932818 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:15.933017 (+ 199us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 09:58:15.934676 (+ 1659us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41931/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 09:58:15.934836 (+ 160us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46996: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41931/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 09:58:15.935007 350 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46996: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41931/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 09:58:15.936939 384 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:15.930174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:40617 (local address 127.0.0.1:46996)
0808 09:58:15.930350 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:15.930368 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:15.930424 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:15.930581 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:15.930582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:15.930583 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0808 09:58:15.930631 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:15.930633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.931636 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.931637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:15.932317 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:15.932321 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:15.932841 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:15.932842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:15.932895 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:15.932901 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 09:58:15.934801 (+ 1900us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41931/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 09:58:15.936839 (+ 2038us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.71.254:40617: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41931/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":1826,"thread_start_us":103,"threads_started":1}
I20260808 09:58:15.937177 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 32710
E20260808 09:58:15.956073 386 webserver.cc:533] Webserver: sslize failed:
E20260808 09:58:15.956187 386 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T09:58:15Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (245 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T09:58:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:15Z Disabled control of system clock
I20260808 09:58:15.994493 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:40123
--webserver_interface=127.24.71.254
--webserver_port=0
--builtin_ntp_servers=127.24.71.212:45069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:40123
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/testchainca.cert with env {}
W20260808 09:58:16.079491 390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:16.079741 390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:16.079782 390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:16.081187 390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:16.081259 390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:16.081279 390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:16.081303 390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:16.081329 390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 09:58:16.081360 390 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 09:58:16.081377 390 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 09:58:16.083151 390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:45069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:40123
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:40123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:16.083472 390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:16.083710 390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:16.088766 400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:16.088766 396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:16.088801 390 server_base.cc:1034] running on GCE node
W20260808 09:58:16.088773 397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:16.089255 390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:16.089526 390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:16.090680 390 hybrid_clock.cc:648] HybridClock initialized: now 1786183096090660 us; error 46 us; skew 500 ppm
I20260808 09:58:16.092056 390 webserver.cc:460] Webserver started at http://127.24.71.254:44923/ using document root <none> and password file <none>
I20260808 09:58:16.092319 390 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:16.092415 390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:16.092569 390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:16.093703 390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "5593305c930b4528b790bada8b868a62"
format_stamp: "Formatted at 2026-08-08 09:58:16 on dist-test-slave-gw5c"
server_key: "d7bb9739c96d352c560b7507995e3a54"
server_key_iv: "2150028ed8578ace60785eb1fa3414a1"
server_key_version: "encryptionkey@0"
I20260808 09:58:16.094076 390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "5593305c930b4528b790bada8b868a62"
format_stamp: "Formatted at 2026-08-08 09:58:16 on dist-test-slave-gw5c"
server_key: "d7bb9739c96d352c560b7507995e3a54"
server_key_iv: "2150028ed8578ace60785eb1fa3414a1"
server_key_version: "encryptionkey@0"
I20260808 09:58:16.095609 390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 09:58:16.096616 407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:16.096812 390 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:16.096936 390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "5593305c930b4528b790bada8b868a62"
format_stamp: "Formatted at 2026-08-08 09:58:16 on dist-test-slave-gw5c"
server_key: "d7bb9739c96d352c560b7507995e3a54"
server_key_iv: "2150028ed8578ace60785eb1fa3414a1"
server_key_version: "encryptionkey@0"
I20260808 09:58:16.097023 390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:16.121668 390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:16.122059 390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:16.122231 390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:16.126482 390 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:40123
I20260808 09:58:16.126530 485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:40123 every 8 connection(s)
I20260808 09:58:16.126925 390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:16.128093 486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:16.129781 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 390
I20260808 09:58:16.129884 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:16.130095 24863 external_mini_cluster.cc:1428] Setting key fd91bd13e3471f067c215f2db374107e
I20260808 09:58:16.131014 486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62: Bootstrap starting.
I20260808 09:58:16.131778 486 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:16.132125 486 log.cc:824] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:16.133004 486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62: No bootstrap required, opened a new log
I20260808 09:58:16.135376 486 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5593305c930b4528b790bada8b868a62" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40123 } }
I20260808 09:58:16.135603 486 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:16.135682 486 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5593305c930b4528b790bada8b868a62, State: Initialized, Role: FOLLOWER
I20260808 09:58:16.135846 486 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5593305c930b4528b790bada8b868a62" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40123 } }
I20260808 09:58:16.135968 486 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:16.136013 486 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:16.136065 486 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:16.136505 490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:16.130672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39284 (local address 127.24.71.254:40123)
0808 09:58:16.130903 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:16.130914 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:16.130947 (+ 33us) server_negotiation.cc:407] Connection header received
0808 09:58:16.131579 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:16.131587 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:16.131668 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:16.131833 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:16.132077 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:16.133387 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:16.134160 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:16.134827 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:16.135002 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:16.135774 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:16.135779 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:16.135779 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:16.136013 (+ 234us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:16.136060 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:16.136075 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:16.136138 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:16.136220 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 09:58:16.136305 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":86,"threads_started":1}
I20260808 09:58:16.136879 486 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5593305c930b4528b790bada8b868a62" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40123 } }
I20260808 09:58:16.137003 486 leader_election.cc:302] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5593305c930b4528b790bada8b868a62; no voters:
I20260808 09:58:16.137189 486 leader_election.cc:288] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:16.137259 492 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:16.137432 492 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [term 1 LEADER]: Becoming Leader. State: Replica: 5593305c930b4528b790bada8b868a62, State: Running, Role: LEADER
I20260808 09:58:16.137481 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 09:58:16.137511 486 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:16.137537 492 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5593305c930b4528b790bada8b868a62" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40123 } }
I20260808 09:58:16.137858 492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5593305c930b4528b790bada8b868a62. Latest consensus state: current_term: 1 leader_uuid: "5593305c930b4528b790bada8b868a62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5593305c930b4528b790bada8b868a62" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40123 } } }
I20260808 09:58:16.137923 492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:16.138032 494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5593305c930b4528b790bada8b868a62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5593305c930b4528b790bada8b868a62" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40123 } } }
I20260808 09:58:16.138130 494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62 [sys.catalog]: This master's current role is: LEADER
W20260808 09:58:16.139425 515 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 09:58:16.139483 515 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 09:58:16.139530 501 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:16.139679 501 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:16.141209 501 catalog_manager.cc:1347] Generated new cluster ID: 9fc66fb8397e43c098748d4e7764156a
I20260808 09:58:16.141269 501 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:16.157361 501 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:16.158154 501 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:16.170665 501 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5593305c930b4528b790bada8b868a62: Generated new TSK 0
I20260808 09:58:16.170918 501 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 09:58:16.236541 490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:16.176010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39300 (local address 127.24.71.254:40123)
0808 09:58:16.176081 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:16.176084 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:16.176221 (+ 137us) server_negotiation.cc:407] Connection header received
0808 09:58:16.176311 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:16.176312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:16.176321 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:16.176384 (+ 63us) server_negotiation.cc:226] Negotiated authn=JWT
0808 09:58:16.176538 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:16.177027 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:16.178185 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:16.178386 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:16.178440 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:16.178638 (+ 198us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 09:58:16.236261 (+ 57623us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 09:58:16.236441 (+ 180us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39300: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 09:58:16.236614 490 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39300: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 09:58:16.237025 526 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:16.175946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:40123 (local address 127.0.0.1:39300)
0808 09:58:16.176148 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:16.176162 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:16.176242 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:16.176408 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:16.176409 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:16.176411 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 09:58:16.176474 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:16.176477 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:16.177112 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:16.177113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:16.178096 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:16.178099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:16.178472 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:16.178473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:16.178537 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:16.178542 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 09:58:16.236763 (+ 58221us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 09:58:16.236916 (+ 153us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.71.254:40123: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":110,"threads_started":1}
I20260808 09:58:16.237391 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 390
2026-08-08T09:58:16Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (278 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (94 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (91 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:58:16 dist-test-slave-gw5c krb5kdc[542](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:58:16 dist-test-slave-gw5c krb5kdc[542](info): set up 2 sockets
Aug 08 09:58:16 dist-test-slave-gw5c krb5kdc[542](info): commencing operation
krb5kdc: starting...
W20260808 09:58:17.688295 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:58:17 dist-test-slave-gw5c krb5kdc[542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:58:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:58:17.813862 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:34775
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:34775
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:17.896831 563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:17.897073 563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:17.897114 563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:17.898315 563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:17.898393 563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:17.898430 563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:17.898461 563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:17.898488 563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:17.900117 563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:34775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:34775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:17.900421 563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:17.900664 563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:17.905596 568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:17.905612 569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:17.905596 571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:17.905933 563 server_base.cc:1034] running on GCE node
I20260808 09:58:17.906246 563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:17.906564 563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:17.907738 563 hybrid_clock.cc:648] HybridClock initialized: now 1786183097907725 us; error 31 us; skew 500 ppm
Aug 08 09:58:17 dist-test-slave-gw5c krb5kdc[542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183097, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:17.910497 563 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:58:17.910918 563 webserver.cc:460] Webserver started at http://127.24.71.254:43241/ using document root <none> and password file <none>
I20260808 09:58:17.911130 563 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:17.911172 563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:17.911276 563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:17.912402 563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "2372a2d33e9943c5885d8b7d1307c073"
format_stamp: "Formatted at 2026-08-08 09:58:17 on dist-test-slave-gw5c"
server_key: "10ced0f7ba99a4d18769758f5dd1058d"
server_key_iv: "7f9986ee4fd3322777059dc3c5001ef8"
server_key_version: "encryptionkey@0"
I20260808 09:58:17.912740 563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "2372a2d33e9943c5885d8b7d1307c073"
format_stamp: "Formatted at 2026-08-08 09:58:17 on dist-test-slave-gw5c"
server_key: "10ced0f7ba99a4d18769758f5dd1058d"
server_key_iv: "7f9986ee4fd3322777059dc3c5001ef8"
server_key_version: "encryptionkey@0"
I20260808 09:58:17.914077 563 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 09:58:17.914844 585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:17.915057 563 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:17.915215 563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "2372a2d33e9943c5885d8b7d1307c073"
format_stamp: "Formatted at 2026-08-08 09:58:17 on dist-test-slave-gw5c"
server_key: "10ced0f7ba99a4d18769758f5dd1058d"
server_key_iv: "7f9986ee4fd3322777059dc3c5001ef8"
server_key_version: "encryptionkey@0"
I20260808 09:58:17.915331 563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:17.935729 563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:17.937971 563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:17.938155 563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:17.942749 563 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:34775
I20260808 09:58:17.942787 661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:34775 every 8 connection(s)
I20260808 09:58:17.943177 563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:17.944134 662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:17.946516 662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073: Bootstrap starting.
I20260808 09:58:17.947151 662 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:17.947525 662 log.cc:824] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:17.948277 662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073: No bootstrap required, opened a new log
I20260808 09:58:17.949507 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 563
I20260808 09:58:17.949647 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:17.949858 24863 external_mini_cluster.cc:1428] Setting key 3ae4fadd90b38efbad435fa577fb2fa7
I20260808 09:58:17.950171 662 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2372a2d33e9943c5885d8b7d1307c073" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34775 } }
I20260808 09:58:17.950446 662 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:17.950507 662 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2372a2d33e9943c5885d8b7d1307c073, State: Initialized, Role: FOLLOWER
I20260808 09:58:17.950691 662 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2372a2d33e9943c5885d8b7d1307c073" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34775 } }
I20260808 09:58:17.950783 662 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:17.950826 662 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:17.950874 662 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:17.952029 662 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2372a2d33e9943c5885d8b7d1307c073" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34775 } }
I20260808 09:58:17.952140 662 leader_election.cc:302] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2372a2d33e9943c5885d8b7d1307c073; no voters:
I20260808 09:58:17.952301 662 leader_election.cc:288] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:17.952381 668 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:17.952574 668 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [term 1 LEADER]: Becoming Leader. State: Replica: 2372a2d33e9943c5885d8b7d1307c073, State: Running, Role: LEADER
I20260808 09:58:17.952706 668 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2372a2d33e9943c5885d8b7d1307c073" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34775 } }
I20260808 09:58:17.952570 662 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:17.953094 670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2372a2d33e9943c5885d8b7d1307c073. Latest consensus state: current_term: 1 leader_uuid: "2372a2d33e9943c5885d8b7d1307c073" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2372a2d33e9943c5885d8b7d1307c073" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34775 } } }
I20260808 09:58:17.953090 669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2372a2d33e9943c5885d8b7d1307c073" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2372a2d33e9943c5885d8b7d1307c073" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34775 } } }
I20260808 09:58:17.953225 670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:17.953502 673 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:17.954118 673 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:17.953231 669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:17.956765 673 catalog_manager.cc:1347] Generated new cluster ID: 503a99d7c2b94afe85c312619e1b3f4b
I20260808 09:58:17.956823 673 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 09:58:17 dist-test-slave-gw5c krb5kdc[542](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:17.961107 667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:17.950456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38958 (local address 127.24.71.254:34775)
0808 09:58:17.950655 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:17.950664 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:17.950697 (+ 33us) server_negotiation.cc:407] Connection header received
0808 09:58:17.950816 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:17.950823 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:17.950883 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:17.951040 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:17.951732 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:17.953139 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:17.954320 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:17.954841 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:17.954925 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:17.957738 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:17.957742 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:17.957743 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:17.957754 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:17.959577 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:17.959963 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:17.959967 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:17.959967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:17.960082 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:17.960307 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:17.960308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:17.960309 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:17.960550 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:17.960733 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:17.960803 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 09:58:17.960942 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":95,"threads_started":1}
I20260808 09:58:17.975191 673 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:17.975841 673 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:17.980366 673 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2372a2d33e9943c5885d8b7d1307c073: Generated new TSK 0
I20260808 09:58:17.980577 673 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 09:58:18.018261 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:34775
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:18.118835 695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:18.119141 695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:18.119182 695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:18.121214 695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:18.121292 695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:18.121335 695 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:18.123080 695 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:34775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:18.123350 695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:18.123631 695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:18.128966 706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:18.128922 705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:18.129228 695 server_base.cc:1034] running on GCE node
W20260808 09:58:18.128922 708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:18.129568 695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:18.129842 695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:18.131033 695 hybrid_clock.cc:648] HybridClock initialized: now 1786183098131018 us; error 47 us; skew 500 ppm
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:18.133754 695 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 09:58:18.134258 695 webserver.cc:460] Webserver started at http://127.24.71.193:42877/ using document root <none> and password file <none>
I20260808 09:58:18.134519 695 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:18.134588 695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:18.134735 695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:18.135876 695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "c6a02f2b222b45f0902b976eb545b478"
format_stamp: "Formatted at 2026-08-08 09:58:18 on dist-test-slave-gw5c"
server_key: "8dfb90c346bffb65e95439d011db5e26"
server_key_iv: "762b47bb3747a4f626914aa4d2a3a4a1"
server_key_version: "encryptionkey@0"
I20260808 09:58:18.136256 695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "c6a02f2b222b45f0902b976eb545b478"
format_stamp: "Formatted at 2026-08-08 09:58:18 on dist-test-slave-gw5c"
server_key: "8dfb90c346bffb65e95439d011db5e26"
server_key_iv: "762b47bb3747a4f626914aa4d2a3a4a1"
server_key_version: "encryptionkey@0"
I20260808 09:58:18.137600 695 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 09:58:18.138347 716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:18.138523 695 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:18.138628 695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "c6a02f2b222b45f0902b976eb545b478"
format_stamp: "Formatted at 2026-08-08 09:58:18 on dist-test-slave-gw5c"
server_key: "8dfb90c346bffb65e95439d011db5e26"
server_key_iv: "762b47bb3747a4f626914aa4d2a3a4a1"
server_key_version: "encryptionkey@0"
I20260808 09:58:18.138700 695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:18.155047 695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:18.157073 695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:18.157245 695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:18.157490 695 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:18.157812 695 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:18.157867 695 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:18.157913 695 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:18.157956 695 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:18.164093 695 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:36621
I20260808 09:58:18.164165 875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:36621 every 8 connection(s)
I20260808 09:58:18.164507 695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 09:58:18.164970 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 695
I20260808 09:58:18.165088 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:58:18.165319 24863 external_mini_cluster.cc:1428] Setting key a7d1bae96c95d14fc37e13fa3bf1740c
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
I20260808 09:58:18.175367 667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:18.165312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:34265 (local address 127.24.71.254:34775)
0808 09:58:18.165385 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:18.165388 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:18.165620 (+ 232us) server_negotiation.cc:407] Connection header received
0808 09:58:18.166871 (+ 1251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:18.166871 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:18.166883 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:18.166944 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:18.167832 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.168635 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.169658 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.169890 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.169975 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:18.172240 (+ 2265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:18.172242 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:18.172242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:18.172258 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:18.173864 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:18.174326 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:18.174327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:18.174328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:18.174398 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:18.174657 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:18.174659 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:18.174659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:18.174785 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:18.174863 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:18.175151 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 09:58:18.175259 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 09:58:18.175539 878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:18.165344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:34775 (local address 127.24.71.193:34265)
0808 09:58:18.165496 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:18.165537 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:18.166744 (+ 1207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:18.167018 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:18.167023 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:18.167452 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:18.167736 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:18.167742 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.168737 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.168738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:18.169552 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:18.169554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.169988 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.169989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:18.170120 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:18.170680 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:18.170692 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:18.172137 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:18.173979 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:18.173988 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:18.173990 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:18.174224 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:18.174467 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:18.174468 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:18.174469 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:18.174580 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:18.174854 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:18.174861 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:18.175006 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 09:58:18.175116 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 09:58:18.175281 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260808 09:58:18.176050 876 heartbeater.cc:347] Connected to a master server at 127.24.71.254:34775
I20260808 09:58:18.176133 876 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:18.176326 876 heartbeater.cc:511] Master 127.24.71.254:34775 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
I20260808 09:58:18.176970 615 ts_manager.cc:194] Registered new tserver with Master: c6a02f2b222b45f0902b976eb545b478 (127.24.71.193:36621)
I20260808 09:58:18.177616 615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:34265
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 09:58:18.192071 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:34775
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:18.292879 882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:18.293159 882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:18.293191 882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:18.294735 882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:18.294777 882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:18.294811 882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:18.296808 882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:34775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:18.297060 882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:18.297298 882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 09:58:18.303696 882 server_base.cc:1034] running on GCE node
W20260808 09:58:18.303779 895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:18.303884 890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:18.303678 893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:18.304219 882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:18.304500 882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:18.305676 882 hybrid_clock.cc:648] HybridClock initialized: now 1786183098305650 us; error 43 us; skew 500 ppm
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:18.308569 882 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 09:58:18.309057 882 webserver.cc:460] Webserver started at http://127.24.71.194:36677/ using document root <none> and password file <none>
I20260808 09:58:18.309314 882 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:18.309388 882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:18.309552 882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:18.310695 882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "f49804e6e9c645cb9f808ea2f382d091"
format_stamp: "Formatted at 2026-08-08 09:58:18 on dist-test-slave-gw5c"
server_key: "4c05221a7c679de1f5854aa3e170bc11"
server_key_iv: "7c2d86552c91e0f5428ebb49ca2e32e8"
server_key_version: "encryptionkey@0"
I20260808 09:58:18.311092 882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "f49804e6e9c645cb9f808ea2f382d091"
format_stamp: "Formatted at 2026-08-08 09:58:18 on dist-test-slave-gw5c"
server_key: "4c05221a7c679de1f5854aa3e170bc11"
server_key_iv: "7c2d86552c91e0f5428ebb49ca2e32e8"
server_key_version: "encryptionkey@0"
I20260808 09:58:18.312700 882 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 09:58:18.313544 902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:18.313742 882 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 09:58:18.313860 882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "f49804e6e9c645cb9f808ea2f382d091"
format_stamp: "Formatted at 2026-08-08 09:58:18 on dist-test-slave-gw5c"
server_key: "4c05221a7c679de1f5854aa3e170bc11"
server_key_iv: "7c2d86552c91e0f5428ebb49ca2e32e8"
server_key_version: "encryptionkey@0"
I20260808 09:58:18.313941 882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:18.328589 882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:18.331229 882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:18.331475 882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:18.331758 882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:18.332100 882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:18.332160 882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:18.332211 882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:18.332254 882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:18.339263 882 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:44281
I20260808 09:58:18.339313 1069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:44281 every 8 connection(s)
I20260808 09:58:18.339740 882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:18.348327 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 882
I20260808 09:58:18.348433 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:58:18.348618 24863 external_mini_cluster.cc:1428] Setting key 662f0830564db7cbdfaf6089cb5a963b
I20260808 09:58:18.351583 667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:18.340599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:40157 (local address 127.24.71.254:34775)
0808 09:58:18.340665 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:18.340668 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:18.340854 (+ 186us) server_negotiation.cc:407] Connection header received
0808 09:58:18.342010 (+ 1156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:18.342012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:18.342027 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:18.342108 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:18.342833 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.343725 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.344803 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.345172 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.345253 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:18.347852 (+ 2599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:18.347854 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:18.347854 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:18.347863 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:18.349814 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:18.350357 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:18.350359 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:18.350359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:18.350451 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:18.350758 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:18.350759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:18.350759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:18.350918 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:18.350995 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:18.351376 (+ 381us) server_negotiation.cc:299] Negotiation successful
0808 09:58:18.351512 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 09:58:18.352087 1072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:18.340555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:34775 (local address 127.24.71.194:40157)
0808 09:58:18.340734 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:18.340773 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:18.341899 (+ 1126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:18.342165 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:18.342168 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:18.342443 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:18.342736 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:18.342741 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.343843 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.343845 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:18.344691 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:18.344693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.345304 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.345305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:18.345424 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:18.346034 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:18.346043 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:18.347745 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:18.349915 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:18.349922 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:18.349924 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:18.350270 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:18.350528 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:18.350529 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:18.350529 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:18.350685 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:18.350994 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:18.351000 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:18.351179 (+ 179us) client_negotiation.cc:769] Sending connection context
0808 09:58:18.351699 (+ 520us) client_negotiation.cc:240] Negotiation successful
0808 09:58:18.351891 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":100,"threads_started":1}
I20260808 09:58:18.352670 1070 heartbeater.cc:347] Connected to a master server at 127.24.71.254:34775
I20260808 09:58:18.352795 1070 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:18.353003 1070 heartbeater.cc:511] Master 127.24.71.254:34775 requested a full tablet report, sending...
I20260808 09:58:18.353410 615 ts_manager.cc:194] Registered new tserver with Master: f49804e6e9c645cb9f808ea2f382d091 (127.24.71.194:44281)
I20260808 09:58:18.353940 615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:40157
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 09:58:18.375900 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:34775
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:18.459923 1077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:18.460150 1077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:18.460176 1077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:18.461427 1077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:18.461472 1077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:18.461499 1077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:18.463547 1077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:34775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:18.463747 1077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:18.463943 1077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 09:58:18.469038 1077 server_base.cc:1034] running on GCE node
W20260808 09:58:18.469082 1085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:18.469048 1084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:18.469172 1087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:18.469501 1077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:18.469756 1077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:18.470942 1077 hybrid_clock.cc:648] HybridClock initialized: now 1786183098470928 us; error 32 us; skew 500 ppm
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:18.473676 1077 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 09:58:18.474130 1077 webserver.cc:460] Webserver started at http://127.24.71.195:37461/ using document root <none> and password file <none>
I20260808 09:58:18.474399 1077 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:18.474470 1077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:18.474625 1077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:18.475790 1077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "71985cad67da499ea802db3038a0d2b1"
format_stamp: "Formatted at 2026-08-08 09:58:18 on dist-test-slave-gw5c"
server_key: "9b4a9346404ee86456461ae8b6dc4f5f"
server_key_iv: "32618bd872e591c66dff4842c00cb124"
server_key_version: "encryptionkey@0"
I20260808 09:58:18.476207 1077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "71985cad67da499ea802db3038a0d2b1"
format_stamp: "Formatted at 2026-08-08 09:58:18 on dist-test-slave-gw5c"
server_key: "9b4a9346404ee86456461ae8b6dc4f5f"
server_key_iv: "32618bd872e591c66dff4842c00cb124"
server_key_version: "encryptionkey@0"
I20260808 09:58:18.477679 1077 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 09:58:18.478551 1098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:18.478790 1077 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:18.478909 1077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "71985cad67da499ea802db3038a0d2b1"
format_stamp: "Formatted at 2026-08-08 09:58:18 on dist-test-slave-gw5c"
server_key: "9b4a9346404ee86456461ae8b6dc4f5f"
server_key_iv: "32618bd872e591c66dff4842c00cb124"
server_key_version: "encryptionkey@0"
I20260808 09:58:18.479009 1077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:18.487260 1077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:18.489689 1077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:18.489862 1077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:18.490110 1077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:18.490438 1077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:18.490494 1077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:18.490536 1077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:18.490578 1077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:18.496502 1077 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:41455
I20260808 09:58:18.496559 1253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:41455 every 8 connection(s)
I20260808 09:58:18.496922 1077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:58:18.501353 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 1077
I20260808 09:58:18.501461 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:58:18.501639 24863 external_mini_cluster.cc:1428] Setting key b160b96c6a64c24e7c6c30c29cf66575
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:18.507844 667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:18.497686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:52209 (local address 127.24.71.254:34775)
0808 09:58:18.497737 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:18.497739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:18.497991 (+ 252us) server_negotiation.cc:407] Connection header received
0808 09:58:18.499016 (+ 1025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:18.499018 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:18.499031 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:18.499091 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:18.499859 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.500467 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.501630 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.501933 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.502021 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:18.504758 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:18.504760 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:18.504760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:18.504767 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:18.506281 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:18.506716 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:18.506718 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:18.506718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:18.506781 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:18.507087 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:18.507088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:18.507088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:18.507203 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:18.507258 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:18.507688 (+ 430us) server_negotiation.cc:299] Negotiation successful
0808 09:58:18.507771 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 09:58:18.508018 1256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:18.497669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:34775 (local address 127.24.71.195:52209)
0808 09:58:18.497854 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:18.497890 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:18.498879 (+ 989us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:18.499167 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:18.499171 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:18.499551 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:18.499757 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:18.499762 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.500570 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.500571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:18.501525 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:18.501528 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.502027 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.502028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:18.502177 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:18.502836 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:18.502848 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:18.504639 (+ 1791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:18.506374 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:18.506381 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:18.506383 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:18.506617 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:18.506879 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:18.506880 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:18.506880 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:18.507012 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:18.507311 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:18.507317 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:18.507540 (+ 223us) client_negotiation.cc:769] Sending connection context
0808 09:58:18.507644 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 09:58:18.507800 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":94,"threads_started":1}
I20260808 09:58:18.508679 1254 heartbeater.cc:347] Connected to a master server at 127.24.71.254:34775
I20260808 09:58:18.508780 1254 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:18.509055 1254 heartbeater.cc:511] Master 127.24.71.254:34775 requested a full tablet report, sending...
I20260808 09:58:18.509539 615 ts_manager.cc:194] Registered new tserver with Master: 71985cad67da499ea802db3038a0d2b1 (127.24.71.195:41455)
I20260808 09:58:18.509961 615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:52209
I20260808 09:58:18.513855 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/test-admin.keytab.
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:18.532049 24863 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 09:58:18.533896 1261 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:18.533001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43112 (local address 127.24.71.193:36621)
0808 09:58:18.533191 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:18.533195 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:18.533207 (+ 12us) server_negotiation.cc:407] Connection header received
0808 09:58:18.533234 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:18.533236 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:18.533250 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:18.533320 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:18.533811 (+ 491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43112: BlockingRecv error: recv got EOF from 127.0.0.1:43112 (error 108)
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":108,"threads_started":1}
W20260808 09:58:18.533991 24863 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/krb5cc' of type FILE
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:18.535112 24863 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:18.536108 24863 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.193@KRBTEST.COM
I20260808 09:58:18.544440 1261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:18.536675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43116 (local address 127.24.71.193:36621)
0808 09:58:18.536744 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:18.536746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:18.536755 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:18.536802 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:18.536803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:18.536813 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:18.536860 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:18.537234 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.537966 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.538673 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.539024 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.539083 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:18.541484 (+ 2401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:18.541494 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:18.541494 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:18.541502 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:18.543236 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:18.543700 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:18.543703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:18.543703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:18.543763 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:18.543931 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:18.543932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:18.543932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:18.544066 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:18.544193 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:18.544267 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 09:58:18.544361 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260808 09:58:18.546635 1261 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:18.546054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43118 (local address 127.24.71.193:36621)
0808 09:58:18.546110 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:18.546112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:18.546122 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:18.546157 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:18.546158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:18.546166 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:18.546228 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:18.546576 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43118: BlockingRecv error: recv got EOF from 127.0.0.1:43118 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 09:58:18.546753 24863 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/krb5cc' of type FILE: Runtime error: Bad format in credentials cache (filename: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/krb5cc)
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:18.547868 24863 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:18.548738 24863 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.193@KRBTEST.COM
I20260808 09:58:18.556816 1261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:18.549348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43130 (local address 127.24.71.193:36621)
0808 09:58:18.549405 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:18.549407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:18.549478 (+ 71us) server_negotiation.cc:407] Connection header received
0808 09:58:18.549557 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:18.549558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:18.549568 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:18.549639 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:18.550046 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.550559 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.551263 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.551539 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.551619 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:18.553961 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:18.553962 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:18.553963 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:18.553971 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:18.555661 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:18.556034 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:18.556036 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:18.556036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:18.556099 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:18.556298 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:18.556299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:18.556299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:18.556416 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:18.556523 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:18.556629 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 09:58:18.556714 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 09:58:18.558460 24863 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786183068256695-24863-0/krb5kdc/krb5cc' of type FILE
W20260808 09:58:18.558467 1261 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:18.557870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43146 (local address 127.24.71.193:36621)
0808 09:58:18.557947 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:18.557949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:18.557959 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:18.558003 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:18.558004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:18.558013 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:18.558070 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:18.558418 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43146: BlockingRecv error: recv got EOF from 127.0.0.1:43146 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:18.559607 24863 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:18.560478 24863 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[542](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.193@KRBTEST.COM
I20260808 09:58:18.567387 1261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:18.560992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43162 (local address 127.24.71.193:36621)
0808 09:58:18.561046 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:18.561049 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:18.561092 (+ 43us) server_negotiation.cc:407] Connection header received
0808 09:58:18.561166 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:18.561167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:18.561176 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:18.561245 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:18.561629 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.562085 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.562763 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:18.562953 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:18.563039 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:18.565119 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:18.565120 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:18.565121 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:18.565127 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:18.566432 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:18.566751 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:18.566752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:18.566752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:18.566809 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:18.566977 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:18.566978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:18.566978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:18.567064 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:18.567133 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:18.567232 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 09:58:18.567285 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 09:58:18.568269 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 695
I20260808 09:58:18.582335 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 882
I20260808 09:58:18.593012 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 1077
I20260808 09:58:18.608688 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 563
2026-08-08T09:58:18Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2187 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[1280](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[1280](info): set up 2 sockets
Aug 08 09:58:18 dist-test-slave-gw5c krb5kdc[1280](info): commencing operation
krb5kdc: starting...
W20260808 09:58:19.850844 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:58:19 dist-test-slave-gw5c krb5kdc[1280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183099, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:58:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:19Z Disabled control of system clock
WARNING: no policy specified for oryx/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.254.keytab.
Entry for principal oryx/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.254.keytab.
I20260808 09:58:19.975771 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:41105
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.254.keytab
--principal=oryx/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:41105
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:20.059535 1298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:20.059782 1298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:20.059819 1298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:20.060953 1298 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:20.061028 1298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:20.061055 1298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:20.061089 1298 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:20.061123 1298 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:20.062592 1298 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:41105
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.254.keytab
--principal=oryx/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:41105
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:20.062873 1298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:20.063104 1298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:20.068174 1305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:20.068349 1298 server_base.cc:1034] running on GCE node
W20260808 09:58:20.068161 1308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:20.068161 1306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:20.068773 1298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:20.069034 1298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:20.070218 1298 hybrid_clock.cc:648] HybridClock initialized: now 1786183100070198 us; error 52 us; skew 500 ppm
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183100, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:20.072896 1298 init.cc:377] Logged in from keytab as oryx/127.24.71.254@KRBTEST.COM (short username oryx)
I20260808 09:58:20.073376 1298 webserver.cc:460] Webserver started at http://127.24.71.254:34211/ using document root <none> and password file <none>
I20260808 09:58:20.073617 1298 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:20.073666 1298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:20.073839 1298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:20.074930 1298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "521226152b5048e4a97fd2c5782a30dd"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "32ec2ba08db769b255fc40698dce1d6a"
server_key_iv: "02364f0a7eba8254f529dd461674b7ce"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.075309 1298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "521226152b5048e4a97fd2c5782a30dd"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "32ec2ba08db769b255fc40698dce1d6a"
server_key_iv: "02364f0a7eba8254f529dd461674b7ce"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.076726 1298 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:20.077517 1318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:20.077694 1298 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:20.077801 1298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "521226152b5048e4a97fd2c5782a30dd"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "32ec2ba08db769b255fc40698dce1d6a"
server_key_iv: "02364f0a7eba8254f529dd461674b7ce"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.077885 1298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:20.104404 1298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:20.106459 1298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:20.106642 1298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:20.111059 1298 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:41105
I20260808 09:58:20.111096 1393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:41105 every 8 connection(s)
I20260808 09:58:20.111521 1298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:20.111966 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 1298
I20260808 09:58:20.112099 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:20.112367 24863 external_mini_cluster.cc:1428] Setting key 18c6018aa79d43987fd66a43a7e43740
I20260808 09:58:20.112785 1394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:20.115770 1394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd: Bootstrap starting.
I20260808 09:58:20.116572 1394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:20.116870 1394 log.cc:824] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:20.117686 1394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd: No bootstrap required, opened a new log
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183099, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
I20260808 09:58:20.120275 1394 raft_consensus.cc:348] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } }
I20260808 09:58:20.120425 1394 raft_consensus.cc:374] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:20.120450 1394 raft_consensus.cc:729] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521226152b5048e4a97fd2c5782a30dd, State: Initialized, Role: FOLLOWER
I20260808 09:58:20.120615 1394 consensus_queue.cc:260] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } }
I20260808 09:58:20.120692 1394 raft_consensus.cc:388] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:20.120715 1394 raft_consensus.cc:482] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:20.120787 1394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:20.121551 1394 raft_consensus.cc:504] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } }
I20260808 09:58:20.121668 1394 leader_election.cc:302] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 521226152b5048e4a97fd2c5782a30dd; no voters:
I20260808 09:58:20.121848 1394 leader_election.cc:288] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:20.121922 1400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:20.122130 1400 raft_consensus.cc:686] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [term 1 LEADER]: Becoming Leader. State: Replica: 521226152b5048e4a97fd2c5782a30dd, State: Running, Role: LEADER
I20260808 09:58:20.122143 1394 sys_catalog.cc:564] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:20.122239 1400 consensus_queue.cc:237] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } }
I20260808 09:58:20.122711 1402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } }
I20260808 09:58:20.122807 1402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:20.123047 1400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 521226152b5048e4a97fd2c5782a30dd. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } }
I20260808 09:58:20.123133 1400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:20.123502 1413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:20.124022 1413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:20.124694 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.112972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50046 (local address 127.24.71.254:41105)
0808 09:58:20.113186 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:20.113196 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:20.113232 (+ 36us) server_negotiation.cc:407] Connection header received
0808 09:58:20.113923 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:20.113929 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:20.113979 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:20.114161 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:20.114847 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.115893 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.117029 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.117434 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.117517 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.120259 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:20.120263 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:20.120263 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:20.120273 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:20.122631 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.123059 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.123062 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.123062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.123172 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.123370 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.123370 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.123371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.123717 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:20.123879 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:20.124347 (+ 468us) server_negotiation.cc:299] Negotiation successful
0808 09:58:20.124492 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":86,"threads_started":1}
I20260808 09:58:20.125615 1413 catalog_manager.cc:1347] Generated new cluster ID: 1f5eee97dbf44a56a4835990db82703a
I20260808 09:58:20.125685 1413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:20.134999 1413 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:20.135766 1413 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:20.137727 1413 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd: Generated new TSK 0
I20260808 09:58:20.137905 1413 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab.
Entry for principal oryx/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab.
I20260808 09:58:20.165779 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:41105
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab
--principal=oryx/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:20.251255 1428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:20.251490 1428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:20.251519 1428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:20.252709 1428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:20.252767 1428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:20.252830 1428 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:20.254336 1428 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab
--principal=oryx/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:41105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:20.254601 1428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:20.254863 1428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:20.260159 1435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:20.260174 1434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:20.260175 1438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:20.260509 1428 server_base.cc:1034] running on GCE node
I20260808 09:58:20.260797 1428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:20.261075 1428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:20.262264 1428 hybrid_clock.cc:648] HybridClock initialized: now 1786183100262241 us; error 38 us; skew 500 ppm
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183100, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:20.265166 1428 init.cc:377] Logged in from keytab as oryx/127.24.71.193@KRBTEST.COM (short username oryx)
I20260808 09:58:20.265602 1428 webserver.cc:460] Webserver started at http://127.24.71.193:33863/ using document root <none> and password file <none>
I20260808 09:58:20.265817 1428 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:20.265864 1428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:20.265960 1428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:20.266997 1428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "598eca03628e46919b5f8eecd58e7b38"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "a0ccadd637e3582f7d9f5192e4e524f2"
server_key_iv: "4cdfe9a1990fbfcd793ae392c29d0455"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.267338 1428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "598eca03628e46919b5f8eecd58e7b38"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "a0ccadd637e3582f7d9f5192e4e524f2"
server_key_iv: "4cdfe9a1990fbfcd793ae392c29d0455"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.268800 1428 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:20.269542 1448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:20.269723 1428 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:20.269806 1428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "598eca03628e46919b5f8eecd58e7b38"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "a0ccadd637e3582f7d9f5192e4e524f2"
server_key_iv: "4cdfe9a1990fbfcd793ae392c29d0455"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.269883 1428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:20.298424 1428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:20.300534 1428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:20.300658 1428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:20.300866 1428 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:20.301231 1428 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:20.301270 1428 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:20.301293 1428 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:20.301306 1428 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:20.307297 1428 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:38263
I20260808 09:58:20.307410 1617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:38263 every 8 connection(s)
I20260808 09:58:20.307786 1428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 09:58:20.311699 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 1428
I20260808 09:58:20.311786 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:58:20.312007 24863 external_mini_cluster.cc:1428] Setting key 8ae687fc1dc9720557b57bb8cecf0ed8
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183100, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
I20260808 09:58:20.318425 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.308607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:53371 (local address 127.24.71.254:41105)
0808 09:58:20.308701 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:20.308703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:20.308897 (+ 194us) server_negotiation.cc:407] Connection header received
0808 09:58:20.309464 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:20.309467 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:20.309481 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:20.309530 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:20.310564 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.311087 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.312317 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.312617 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.312688 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.315173 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:20.315174 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:20.315175 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:20.315184 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:20.316758 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.317333 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.317333 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.317334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.317390 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.317690 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.317691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.317691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.317804 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:20.317859 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:20.318247 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 09:58:20.318350 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":38}
I20260808 09:58:20.318729 1621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.308561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.193:53371)
0808 09:58:20.308764 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:20.308803 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:20.309332 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:20.309619 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:20.309623 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:20.310228 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:20.310448 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.310452 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.311199 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.311201 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.312217 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.312222 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.312716 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.312717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.312870 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.313450 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:20.313459 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:20.315072 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:20.316850 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.316859 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.316862 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.317199 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.317469 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.317470 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.317471 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.317618 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.317874 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:20.317881 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:20.318074 (+ 193us) client_negotiation.cc:769] Sending connection context
0808 09:58:20.318214 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 09:58:20.318429 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":93,"threads_started":1}
I20260808 09:58:20.319437 1619 heartbeater.cc:347] Connected to a master server at 127.24.71.254:41105
I20260808 09:58:20.319538 1619 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:20.319746 1619 heartbeater.cc:511] Master 127.24.71.254:41105 requested a full tablet report, sending...
I20260808 09:58:20.320299 1343 ts_manager.cc:194] Registered new tserver with Master: 598eca03628e46919b5f8eecd58e7b38 (127.24.71.193:38263)
I20260808 09:58:20.320865 1343 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:53371
WARNING: no policy specified for oryx/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab.
Entry for principal oryx/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab.
I20260808 09:58:20.339915 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:41105
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab
--principal=oryx/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:20.423281 1626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:20.423601 1626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:20.423643 1626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:20.424831 1626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:20.424903 1626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:20.424950 1626 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:20.426474 1626 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab
--principal=oryx/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:41105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:20.426764 1626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:20.427006 1626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:20.432118 1638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:20.432147 1632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:20.432147 1636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:20.432313 1626 server_base.cc:1034] running on GCE node
I20260808 09:58:20.432570 1626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:20.432822 1626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:20.433987 1626 hybrid_clock.cc:648] HybridClock initialized: now 1786183100433972 us; error 29 us; skew 500 ppm
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183100, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:20.436631 1626 init.cc:377] Logged in from keytab as oryx/127.24.71.194@KRBTEST.COM (short username oryx)
I20260808 09:58:20.437032 1626 webserver.cc:460] Webserver started at http://127.24.71.194:41659/ using document root <none> and password file <none>
I20260808 09:58:20.437302 1626 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:20.437350 1626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:20.437448 1626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:20.438467 1626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "83edd72a23b543e0aa22dad2db0ca8bd"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "dd22a5fc7cc0feb98c2782a415d0626b"
server_key_iv: "15f7f999eb6e66df1d87ff81ffb845a6"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.438776 1626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "83edd72a23b543e0aa22dad2db0ca8bd"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "dd22a5fc7cc0feb98c2782a415d0626b"
server_key_iv: "15f7f999eb6e66df1d87ff81ffb845a6"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.440145 1626 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:20.440850 1646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:20.441039 1626 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:20.441123 1626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "83edd72a23b543e0aa22dad2db0ca8bd"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "dd22a5fc7cc0feb98c2782a415d0626b"
server_key_iv: "15f7f999eb6e66df1d87ff81ffb845a6"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.441176 1626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:20.464861 1626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:20.467317 1626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:20.467492 1626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:20.467754 1626 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:20.468081 1626 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:20.468115 1626 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:20.468138 1626 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:20.468185 1626 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:20.474148 1626 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:37603
I20260808 09:58:20.474207 1809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:37603 every 8 connection(s)
I20260808 09:58:20.474526 1626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:58:20.475966 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 1626
I20260808 09:58:20.476056 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:58:20.476238 24863 external_mini_cluster.cc:1428] Setting key f7088fd656ead493a60da88e3ffa4841
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183100, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
I20260808 09:58:20.485344 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.475270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:50665 (local address 127.24.71.254:41105)
0808 09:58:20.475435 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:20.475437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:20.475611 (+ 174us) server_negotiation.cc:407] Connection header received
0808 09:58:20.476237 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:20.476239 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:20.476252 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:20.476308 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:20.477525 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.478024 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.479474 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.479670 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.479727 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.482282 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:20.482284 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:20.482284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:20.482293 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:20.483965 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.484349 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.484350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.484351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.484427 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.484658 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.484659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.484659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.484814 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:20.484893 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:20.485140 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 09:58:20.485233 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 09:58:20.485417 1812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.475224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.194:50665)
0808 09:58:20.475463 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:20.475511 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:20.476117 (+ 606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:20.476392 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:20.476396 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:20.477213 (+ 817us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:20.477417 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.477423 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.478124 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.478125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.479319 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.479323 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.479755 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.479757 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.479925 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.480496 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:20.480507 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:20.482203 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:20.484047 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.484054 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.484056 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.484270 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.484496 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.484496 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.484496 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.484591 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.484885 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:20.484890 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:20.485006 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 09:58:20.485090 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 09:58:20.485214 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":93,"threads_started":1}
I20260808 09:58:20.485961 1810 heartbeater.cc:347] Connected to a master server at 127.24.71.254:41105
I20260808 09:58:20.486080 1810 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:20.486299 1810 heartbeater.cc:511] Master 127.24.71.254:41105 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.24.71.195@KRBTEST.COM; defaulting to no policy
I20260808 09:58:20.486773 1343 ts_manager.cc:194] Registered new tserver with Master: 83edd72a23b543e0aa22dad2db0ca8bd (127.24.71.194:37603)
I20260808 09:58:20.487155 1343 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:50665
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab.
Entry for principal oryx/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab.
I20260808 09:58:20.506106 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:41105
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab
--principal=oryx/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:20.589352 1817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:20.589560 1817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:20.589582 1817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:20.590728 1817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:20.590776 1817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:20.590803 1817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:20.592301 1817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab
--principal=oryx/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:41105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:20.592558 1817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:20.592814 1817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:20.597870 1829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:20.597925 1817 server_base.cc:1034] running on GCE node
W20260808 09:58:20.597849 1826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:20.597855 1825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:20.598277 1817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:20.598595 1817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:20.599778 1817 hybrid_clock.cc:648] HybridClock initialized: now 1786183100599757 us; error 36 us; skew 500 ppm
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183100, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:20.602419 1817 init.cc:377] Logged in from keytab as oryx/127.24.71.195@KRBTEST.COM (short username oryx)
I20260808 09:58:20.602806 1817 webserver.cc:460] Webserver started at http://127.24.71.195:44313/ using document root <none> and password file <none>
I20260808 09:58:20.603008 1817 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:20.603049 1817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:20.603147 1817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:20.604224 1817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "a549b4bf061f4cc88df1bca82e670696"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "6c89fce03481fb8affaaff9157dd745b"
server_key_iv: "91955de36e2ed561549b7a16a2761d8c"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.604528 1817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "a549b4bf061f4cc88df1bca82e670696"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "6c89fce03481fb8affaaff9157dd745b"
server_key_iv: "91955de36e2ed561549b7a16a2761d8c"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.605842 1817 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 09:58:20.606531 1844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:20.606719 1817 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 09:58:20.606812 1817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "a549b4bf061f4cc88df1bca82e670696"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "6c89fce03481fb8affaaff9157dd745b"
server_key_iv: "91955de36e2ed561549b7a16a2761d8c"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.606897 1817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:20.628094 1817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:20.630002 1817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:20.630157 1817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:20.630425 1817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:20.630752 1817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:20.630786 1817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:20.630831 1817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:20.630859 1817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:20.636624 1817 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:36949
I20260808 09:58:20.636715 2010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:36949 every 8 connection(s)
I20260808 09:58:20.637014 1817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:58:20.641994 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 1817
I20260808 09:58:20.642099 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:58:20.642284 24863 external_mini_cluster.cc:1428] Setting key 46a3d6ca1eabd1a0d580d5bb7df75e71
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183100, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
I20260808 09:58:20.646417 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.637826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:41569 (local address 127.24.71.254:41105)
0808 09:58:20.637883 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:20.637885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:20.638095 (+ 210us) server_negotiation.cc:407] Connection header received
0808 09:58:20.638654 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:20.638656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:20.638665 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:20.638718 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:20.639700 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.640191 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.641115 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.641293 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.641342 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.643792 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:20.643793 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:20.643794 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:20.643801 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:20.645285 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.645648 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.645648 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.645649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.645701 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.645904 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.645904 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.645905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.646005 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:20.646058 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:20.646278 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 09:58:20.646343 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 09:58:20.646593 2013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.637800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.195:41569)
0808 09:58:20.637973 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:20.638009 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:20.638569 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:20.638768 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:20.638771 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:20.639353 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:20.639625 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.639631 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.640270 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.640271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.641043 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.641044 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.641362 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.641363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.641472 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.641920 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:20.641930 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:20.643675 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:20.645358 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.645364 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.645365 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.645582 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.645756 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.645756 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.645757 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.645850 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.646059 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:20.646063 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:20.646172 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 09:58:20.646252 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 09:58:20.646391 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":100,"threads_started":1}
I20260808 09:58:20.647045 2011 heartbeater.cc:347] Connected to a master server at 127.24.71.254:41105
I20260808 09:58:20.647128 2011 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:20.647331 2011 heartbeater.cc:511] Master 127.24.71.254:41105 requested a full tablet report, sending...
I20260808 09:58:20.647749 1343 ts_manager.cc:194] Registered new tserver with Master: a549b4bf061f4cc88df1bca82e670696 (127.24.71.195:36949)
I20260808 09:58:20.648126 1343 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:41569
I20260808 09:58:20.654251 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.24.71.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.71.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.71.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.253.keytab.
Entry for principal oryx/127.24.71.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.253.keytab.
I20260808 09:58:20.681838 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.253:39277
--webserver_interface=127.24.71.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.253.keytab
--principal=oryx/127.24.71.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:41105,127.24.71.253:39277
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:20.765272 2017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:20.765491 2017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:20.765513 2017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:20.766675 2017 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:20.766718 2017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:20.766733 2017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:20.766789 2017 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:20.766815 2017 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:20.768326 2017 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:41105,127.24.71.253:39277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.253.keytab
--principal=oryx/127.24.71.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.253:39277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.71.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
W20260808 09:58:20.768435 2017 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.24.71.254:41105,127.24.71.253:39277'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 09:58:20.768620 2017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:20.768872 2017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:20.773757 2031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:20.773757 2028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:20.773802 2029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:20.774055 2017 server_base.cc:1034] running on GCE node
I20260808 09:58:20.774289 2017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:20.774539 2017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:20.775673 2017 hybrid_clock.cc:648] HybridClock initialized: now 1786183100775656 us; error 33 us; skew 500 ppm
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183100, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:20.778227 2017 init.cc:377] Logged in from keytab as oryx/127.24.71.253@KRBTEST.COM (short username oryx)
I20260808 09:58:20.778693 2017 webserver.cc:460] Webserver started at http://127.24.71.253:40343/ using document root <none> and password file <none>
I20260808 09:58:20.778908 2017 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:20.778947 2017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:20.779050 2017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:20.780221 2017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/data/instance:
uuid: "bdfd5bbc5cad4546a5bbeccce71a8809"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "d0362dbe9d9c755a3f2c231d78f5bed2"
server_key_iv: "b0e322e09b8d2d1aadf6f95d76b41707"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.780539 2017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/wal/instance:
uuid: "bdfd5bbc5cad4546a5bbeccce71a8809"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "d0362dbe9d9c755a3f2c231d78f5bed2"
server_key_iv: "b0e322e09b8d2d1aadf6f95d76b41707"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.782042 2017 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 09:58:20.782888 2040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:20.783301 2017 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:20.783469 2017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/wal
uuid: "bdfd5bbc5cad4546a5bbeccce71a8809"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "d0362dbe9d9c755a3f2c231d78f5bed2"
server_key_iv: "b0e322e09b8d2d1aadf6f95d76b41707"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.783560 2017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:20.800007 2017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:20.801916 2017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:20.802088 2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:20.806483 2017 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.253:39277
I20260808 09:58:20.806524 2115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.253:39277 every 8 connection(s)
I20260808 09:58:20.806908 2017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/data/info.pb
I20260808 09:58:20.807602 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 2017
I20260808 09:58:20.808481 2116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:20.810503 2116 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183099, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.71.253@KRBTEST.COM
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183100, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.253@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
I20260808 09:58:20.819351 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.811215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50060 (local address 127.24.71.254:41105)
0808 09:58:20.811274 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:20.811277 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:20.811486 (+ 209us) server_negotiation.cc:407] Connection header received
0808 09:58:20.811559 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:20.811560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:20.811571 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:20.811618 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:20.812177 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.812888 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.814043 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.814230 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.814283 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.816480 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:20.816482 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:20.816482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:20.816490 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:20.818084 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.818446 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.818447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.818448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.818511 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.818712 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.818713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.818714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.818866 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:20.818989 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:20.819177 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 09:58:20.819265 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 09:58:20.819380 2121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.811132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50060)
0808 09:58:20.811354 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:20.811417 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:20.811495 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:20.811662 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:20.811665 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:20.812026 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:20.812100 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.812102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.813020 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.813021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.813951 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.813954 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.814316 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.814318 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.814389 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.814865 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:20.814873 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:20.816380 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:20.818160 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.818166 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.818169 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.818364 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.818580 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.818581 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.818582 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.818643 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.818965 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:20.818983 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:20.819035 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 09:58:20.819122 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 09:58:20.819233 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":99,"threads_started":1}
I20260808 09:58:20.819383 2119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.808411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41628 (local address 127.24.71.253:39277)
0808 09:58:20.808597 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:20.808607 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:20.808645 (+ 38us) server_negotiation.cc:407] Connection header received
0808 09:58:20.809109 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:20.809116 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:20.809163 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:20.809340 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:20.810036 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.811101 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.812327 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.812936 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.813038 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.815785 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:20.815791 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:20.815791 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:20.815797 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:20.817632 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.818040 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.818043 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.818043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.818119 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.818342 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.818343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.818344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.818575 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:20.818733 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:20.818842 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 09:58:20.819090 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":83,"threads_started":1}
I20260808 09:58:20.820075 2116 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183100, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.253@KRBTEST.COM for oryx/127.24.71.253@KRBTEST.COM
I20260808 09:58:20.826290 2121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.820348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:39277 (local address 127.0.0.1:41642)
0808 09:58:20.820386 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:20.820420 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:20.820473 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:20.820591 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:20.820592 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:20.820723 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:20.820765 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.820766 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.821387 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.821387 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.821852 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.821853 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.822215 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.822215 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.822280 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.822677 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:20.822682 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:20.824005 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:20.825270 (+ 1265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.825271 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.825272 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.825442 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.825633 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.825633 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.825634 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.825694 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.825950 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:20.825951 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:20.825988 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 09:58:20.826065 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 09:58:20.826161 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260808 09:58:20.826334 2119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.820379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41642 (local address 127.24.71.253:39277)
0808 09:58:20.820427 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:20.820429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:20.820457 (+ 28us) server_negotiation.cc:407] Connection header received
0808 09:58:20.820526 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:20.820527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:20.820535 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:20.820589 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:20.820837 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.821295 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.821932 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.822133 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.822206 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.824093 (+ 1887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:20.824094 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:20.824095 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:20.824101 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:20.825187 (+ 1086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.825512 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.825513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.825514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.825567 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.825761 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.825762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.825762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.825863 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:20.825956 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:20.826085 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 09:58:20.826210 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":32}
I20260808 09:58:20.827740 2116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: Bootstrap starting.
I20260808 09:58:20.828598 2116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:20.828926 2116 log.cc:824] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:20.829710 2116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: No bootstrap required, opened a new log
I20260808 09:58:20.831104 2116 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } }
I20260808 09:58:20.831225 2116 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:20.831249 2116 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfd5bbc5cad4546a5bbeccce71a8809, State: Initialized, Role: FOLLOWER
I20260808 09:58:20.831449 2116 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } }
I20260808 09:58:20.831743 2123 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } } }
I20260808 09:58:20.831790 2116 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:20.831847 2123 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 09:58:20.833457 2140 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 09:58:20.833518 2140 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 09:58:20.835126 2017 master_runner.cc:428] Detected that this master bdfd5bbc5cad4546a5bbeccce71a8809 is joining an existing cluster
I20260808 09:58:20.835187 2017 master_runner.cc:432] Initiating AddMaster RPC to add 127.24.71.253:39277
I20260808 09:58:20.844010 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.836197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50072)
0808 09:58:20.836391 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:20.836403 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:20.836464 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:20.836784 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:20.836785 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:20.837073 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:20.837140 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.837142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.838029 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.838030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.838923 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.838926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.839327 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.839329 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.839431 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.839919 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:20.839924 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:20.840351 (+ 427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:20.842233 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.842234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.842235 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.842546 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.843088 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.843089 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.843090 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.843159 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.843566 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:20.843568 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:20.843629 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 09:58:20.843704 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 09:58:20.843864 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":98,"threads_started":1}
I20260808 09:58:20.844038 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.836222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50072 (local address 127.24.71.254:41105)
0808 09:58:20.836294 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:20.836297 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:20.836604 (+ 307us) server_negotiation.cc:407] Connection header received
0808 09:58:20.836638 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:20.836639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:20.836653 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:20.836728 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:20.837222 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.837975 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.839017 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.839197 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.839297 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.840440 (+ 1143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:20.840441 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:20.840442 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:20.840449 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:20.842127 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.842936 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.842937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.842938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.843008 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.843294 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.843295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.843296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.843483 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:20.843560 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:20.843864 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 09:58:20.843941 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 09:58:20.845297 2119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.836536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41652 (local address 127.24.71.253:39277)
0808 09:58:20.836581 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:20.836583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:20.836647 (+ 64us) server_negotiation.cc:407] Connection header received
0808 09:58:20.836709 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:20.836710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:20.836719 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:20.836773 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:20.837150 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.837889 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.839973 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.840245 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.840320 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.841330 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:20.841332 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:20.841332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:20.841340 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:20.843620 (+ 2280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.844482 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.844483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.844483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.844531 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.844774 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.844775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.844775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.844910 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:20.844983 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:20.845138 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 09:58:20.845211 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 09:58:20.845589 2148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.836458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:39277 (local address 127.0.0.1:41652)
0808 09:58:20.836574 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:20.836582 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:20.836654 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:20.836778 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:20.836778 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:20.836993 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:20.837064 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.837066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.837971 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.837972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.839897 (+ 1925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.839900 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.840336 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.840337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.840409 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.840838 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:20.840843 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:20.841254 (+ 411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:20.843716 (+ 2462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.843717 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.843717 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.843982 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.844660 (+ 678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.844660 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.844660 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.844701 (+ 41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.845006 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:20.845006 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:20.845041 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 09:58:20.845398 (+ 357us) client_negotiation.cc:240] Negotiation successful
0808 09:58:20.845492 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":82,"threads_started":1}
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183100, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.254@KRBTEST.COM for oryx/127.24.71.253@KRBTEST.COM
I20260808 09:58:20.854727 2119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.847126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41662 (local address 127.24.71.253:39277)
0808 09:58:20.847169 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:20.847171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:20.847334 (+ 163us) server_negotiation.cc:407] Connection header received
0808 09:58:20.847450 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:20.847451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:20.847460 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:20.847523 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:20.848021 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.848447 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.849556 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.849723 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.849771 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.851985 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:20.851986 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:20.851987 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:20.851994 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:20.853425 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.853853 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.853855 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.853855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.853920 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.854144 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.854145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.854145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.854261 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:20.854333 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:20.854545 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 09:58:20.854626 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 09:58:20.854760 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.847029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:39277 (local address 127.0.0.1:41662)
0808 09:58:20.847211 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:20.847264 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:20.847344 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:20.847533 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:20.847536 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:20.847884 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:20.847946 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.847948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.848524 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.848525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.849473 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.849476 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.849793 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.849794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.849881 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.850296 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:20.850301 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:20.851886 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:20.853536 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.853546 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.853549 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.853772 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.854005 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.854005 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.854006 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.854073 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.854337 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:20.854347 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:20.854419 (+ 72us) client_negotiation.cc:769] Sending connection context
0808 09:58:20.854506 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 09:58:20.854640 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":105,"threads_started":1}
I20260808 09:58:20.855612 1343 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.24.71.253:39277: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809"
member_type: NON_VOTER
last_known_addr {
host: "127.24.71.253"
port: 39277
}
attrs {
promote: true
}
}
dest_uuid: "521226152b5048e4a97fd2c5782a30dd"
cas_config_opid_index: -1
I20260808 09:58:20.855973 1343 consensus_queue.cc:237] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true } }
I20260808 09:58:20.856489 2153 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER bdfd5bbc5cad4546a5bbeccce71a8809 (127.24.71.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true } } }
I20260808 09:58:20.856926 2076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:20.857775 2153 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.24.71.253:39277
I20260808 09:58:20.857930 2076 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Refusing update from remote peer 521226152b5048e4a97fd2c5782a30dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 09:58:20.858064 2017 master.cc:537] Master@127.24.71.253:39277 shutting down...
I20260808 09:58:20.858238 2152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true } } }
I20260808 09:58:20.858335 2152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:20.858461 2152 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 09:58:20.859154 1321 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 09:58:20.859750 1321 consensus_peers.cc:487] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd -> Peer bdfd5bbc5cad4546a5bbeccce71a8809 (127.24.71.253:39277): Couldn't send request to peer bdfd5bbc5cad4546a5bbeccce71a8809. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 09:58:20.860526 2123 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:20.860627 2123 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } }
I20260808 09:58:20.860845 2123 leader_election.cc:288] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105)
I20260808 09:58:20.861038 2017 raft_consensus.cc:2229] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:20.861018 1357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521226152b5048e4a97fd2c5782a30dd" is_pre_election: true
I20260808 09:58:20.861124 2017 raft_consensus.cc:2258] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:20.861166 2017 tablet_replica.cc:330] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: stopping tablet replica
I20260808 09:58:20.861397 2043 leader_election.cc:302] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: bdfd5bbc5cad4546a5bbeccce71a8809; no voters: 521226152b5048e4a97fd2c5782a30dd
W20260808 09:58:20.861495 2043 raft_consensus.cc:2670] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260808 09:58:20.874826 2017 master.cc:552] Master@127.24.71.253:39277 shutdown complete.
I20260808 09:58:20.874892 2017 master_runner.cc:305] Clearing existing system tablet
I20260808 09:58:20.875033 2017 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:20.875085 2017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:20.875876 2017 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:20.876452 2157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:20.876611 2017 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:20.876675 2017 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:20.876700 2017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/wal
uuid: "bdfd5bbc5cad4546a5bbeccce71a8809"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "d0362dbe9d9c755a3f2c231d78f5bed2"
server_key_iv: "b0e322e09b8d2d1aadf6f95d76b41707"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.877528 2017 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:20.878887 2017 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 09:58:20.878964 2017 log.cc:1196] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 09:58:20.879187 2017 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: Deleting consensus metadata
I20260808 09:58:20.879314 2017 master_runner.cc:315] Copying system tablet from 127.24.71.254:41105
I20260808 09:58:20.879973 2017 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: tablet copy: Beginning tablet copy session from remote peer at address 127.24.71.254:41105
I20260808 09:58:20.886577 2165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.880300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50088)
0808 09:58:20.880431 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:20.880444 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:20.880513 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:20.880675 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:20.880676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:20.880845 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:20.880907 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.880909 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.881946 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.881947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.882502 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:20.882503 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.882983 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.882984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:20.883032 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.883622 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:20.883627 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:20.883936 (+ 309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:20.885646 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.885647 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.885647 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.885815 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.886020 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:20.886020 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:20.886021 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:20.886070 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:20.886328 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:20.886329 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:20.886364 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 09:58:20.886417 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 09:58:20.886495 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":90,"threads_started":1}
I20260808 09:58:20.886634 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.880363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50088 (local address 127.24.71.254:41105)
0808 09:58:20.880426 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:20.880428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:20.880499 (+ 71us) server_negotiation.cc:407] Connection header received
0808 09:58:20.880593 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:20.880594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:20.880605 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:20.880663 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:20.881031 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.881862 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.882587 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.882904 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.882979 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.884021 (+ 1042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:20.884022 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:20.884022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:20.884030 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:20.885562 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.885886 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.885887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.885888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.885952 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.886129 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.886130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.886130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.886264 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:20.886337 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:20.886457 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 09:58:20.886536 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 09:58:20.886986 1372 tablet_copy_service.cc:140] P 521226152b5048e4a97fd2c5782a30dd: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer bdfd5bbc5cad4546a5bbeccce71a8809 ({username='oryx', principal='oryx/127.24.71.253@KRBTEST.COM'} at 127.0.0.1:50088)
I20260808 09:58:20.887069 1372 tablet_copy_service.cc:161] P 521226152b5048e4a97fd2c5782a30dd: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer bdfd5bbc5cad4546a5bbeccce71a8809 at {username='oryx', principal='oryx/127.24.71.253@KRBTEST.COM'} at 127.0.0.1:50088: session id = bdfd5bbc5cad4546a5bbeccce71a8809-00000000000000000000000000000000
I20260808 09:58:20.888020 1372 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 09:58:20.888706 2017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 09:58:20.890028 2017 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: tablet copy: Starting download of 0 data blocks...
I20260808 09:58:20.890188 2017 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: tablet copy: Starting download of 1 WAL segments...
I20260808 09:58:20.891134 2017 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 09:58:20.892094 1372 tablet_copy_service.cc:342] P 521226152b5048e4a97fd2c5782a30dd: Request end of tablet copy session bdfd5bbc5cad4546a5bbeccce71a8809-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.24.71.253@KRBTEST.COM'} at 127.0.0.1:50088
I20260808 09:58:20.892155 1372 tablet_copy_service.cc:433] P 521226152b5048e4a97fd2c5782a30dd: ending tablet copy session bdfd5bbc5cad4546a5bbeccce71a8809-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer bdfd5bbc5cad4546a5bbeccce71a8809
I20260808 09:58:20.894832 2017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:20.896081 2170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:20.896131 2167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:20.896129 2166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:20.896312 2017 server_base.cc:1034] running on GCE node
I20260808 09:58:20.896472 2017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:20.896658 2017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:20.897791 2017 hybrid_clock.cc:648] HybridClock initialized: now 1786183100897781 us; error 25 us; skew 500 ppm
Aug 08 09:58:20 dist-test-slave-gw5c krb5kdc[1280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183100, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:20.899168 2017 init.cc:377] Logged in from keytab as oryx/127.24.71.253@KRBTEST.COM (short username oryx)
I20260808 09:58:20.899528 2017 webserver.cc:460] Webserver started at http://127.24.71.253:42991/ using document root <none> and password file <none>
I20260808 09:58:20.899672 2017 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:20.899710 2017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:20.900349 2017 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:20.900906 2180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:20.901028 2017 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:20.901077 2017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/wal
uuid: "bdfd5bbc5cad4546a5bbeccce71a8809"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "d0362dbe9d9c755a3f2c231d78f5bed2"
server_key_iv: "b0e322e09b8d2d1aadf6f95d76b41707"
server_key_version: "encryptionkey@0"
I20260808 09:58:20.901137 2017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:20.922878 2017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:20.924806 2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:20.928241 2017 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.253:39277
I20260808 09:58:20.928459 2257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.253:39277 every 8 connection(s)
I20260808 09:58:20.928665 2017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-1/data/info.pb
I20260808 09:58:20.929492 2259 sys_catalog.cc:263] Verifying existing consensus state
I20260808 09:58:20.929930 2259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: Bootstrap starting.
I20260808 09:58:20.932337 2259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 09:58:20.932583 2259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: Bootstrap complete.
I20260808 09:58:20.932797 2259 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true } }
I20260808 09:58:20.932893 2259 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bdfd5bbc5cad4546a5bbeccce71a8809, State: Initialized, Role: LEARNER
I20260808 09:58:20.932943 2259 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true } }
I20260808 09:58:20.933151 2259 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:20.933137 2262 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true } } }
I20260808 09:58:20.933223 2262 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: This master's current role is: LEARNER
I20260808 09:58:20.934623 2279 catalog_manager.cc:1259] Loaded cluster ID: 1f5eee97dbf44a56a4835990db82703a
I20260808 09:58:20.934696 2279 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: loading cluster ID for follower catalog manager: success
I20260808 09:58:20.935751 2279 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: acquiring CA information for follower catalog manager: success
I20260808 09:58:20.936056 2279 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 09:58:20.978528 2280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:20.971917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41674 (local address 127.24.71.253:39277)
0808 09:58:20.972059 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:20.972061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:20.972076 (+ 15us) server_negotiation.cc:407] Connection header received
0808 09:58:20.972100 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:20.972100 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:20.972110 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:20.972193 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:20.972831 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.973492 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.974223 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:20.974423 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:20.974502 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:20.975846 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:20.975847 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:20.975848 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:20.975855 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:20.977353 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.977721 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.977723 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.977723 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.977786 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:20.977989 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:20.977990 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:20.977990 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:20.978104 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:20.978233 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:20.978336 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 09:58:20.978418 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
WARNING: no policy specified for oryx/127.24.71.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.71.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.71.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.252.keytab.
Entry for principal oryx/127.24.71.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.252.keytab.
I20260808 09:58:21.005697 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.252:34959
--webserver_interface=127.24.71.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.252.keytab
--principal=oryx/127.24.71.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:41105,127.24.71.253:39277,127.24.71.252:34959
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:21.090399 2286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:21.090649 2286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:21.090689 2286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:21.091941 2286 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:21.092010 2286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:21.092037 2286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:21.092070 2286 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:21.092103 2286 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:21.093633 2286 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:41105,127.24.71.253:39277,127.24.71.252:34959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.252.keytab
--principal=oryx/127.24.71.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.252:34959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.71.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:21.093920 2286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:21.094154 2286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:21.098927 2298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:21.098948 2296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:21.099052 2286 server_base.cc:1034] running on GCE node
W20260808 09:58:21.099263 2294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:21.099615 2286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:21.099925 2286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:21.101073 2286 hybrid_clock.cc:648] HybridClock initialized: now 1786183101101060 us; error 23 us; skew 500 ppm
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:21.103677 2286 init.cc:377] Logged in from keytab as oryx/127.24.71.252@KRBTEST.COM (short username oryx)
I20260808 09:58:21.104164 2286 webserver.cc:460] Webserver started at http://127.24.71.252:34943/ using document root <none> and password file <none>
I20260808 09:58:21.104400 2286 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:21.104446 2286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:21.104588 2286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:21.105715 2286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/data/instance:
uuid: "bda4746da1f7494b8cd2c141fab95e92"
format_stamp: "Formatted at 2026-08-08 09:58:21 on dist-test-slave-gw5c"
server_key: "2c565b2e1bee5da68650de0e638a0116"
server_key_iv: "34d9fecd422e3d1810324e00616d11c3"
server_key_version: "encryptionkey@0"
I20260808 09:58:21.106093 2286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/wal/instance:
uuid: "bda4746da1f7494b8cd2c141fab95e92"
format_stamp: "Formatted at 2026-08-08 09:58:21 on dist-test-slave-gw5c"
server_key: "2c565b2e1bee5da68650de0e638a0116"
server_key_iv: "34d9fecd422e3d1810324e00616d11c3"
server_key_version: "encryptionkey@0"
I20260808 09:58:21.107771 2286 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 09:58:21.108693 2307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:21.108886 2286 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:21.109002 2286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/wal
uuid: "bda4746da1f7494b8cd2c141fab95e92"
format_stamp: "Formatted at 2026-08-08 09:58:21 on dist-test-slave-gw5c"
server_key: "2c565b2e1bee5da68650de0e638a0116"
server_key_iv: "34d9fecd422e3d1810324e00616d11c3"
server_key_version: "encryptionkey@0"
I20260808 09:58:21.109087 2286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:21.121819 2286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:21.124269 2286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:21.124446 2286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:21.128742 2286 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.252:34959
I20260808 09:58:21.128783 2376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.252:34959 every 8 connection(s)
I20260808 09:58:21.129141 2286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/data/info.pb
I20260808 09:58:21.130453 2377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:21.131352 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 2286
I20260808 09:58:21.133111 2377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.252@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183099, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.71.252@KRBTEST.COM
I20260808 09:58:21.143302 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.134148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50104 (local address 127.24.71.254:41105)
0808 09:58:21.134419 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.134421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.134430 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:21.134453 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.134454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.134464 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.134518 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.135078 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.135831 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.137065 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.137349 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.137429 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.139743 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.139744 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.139744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.139751 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.141523 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.141996 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.141998 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.141998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.142064 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.142613 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.142614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.142615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.142772 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.142857 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.143094 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.143189 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208}
I20260808 09:58:21.143548 2383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.134026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50104)
0808 09:58:21.134211 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.134255 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.134304 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.134606 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.134610 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.134895 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.134980 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.134984 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.135933 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.135934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.136986 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.136989 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.137505 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.137506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.137586 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.138115 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.138123 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.139658 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.141614 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.141620 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.141622 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.141920 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.142376 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.142377 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.142377 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.142534 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.142853 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.142859 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.142940 (+ 81us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.143049 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.143237 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":106,"threads_started":1}
I20260808 09:58:21.143551 2381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.132340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54786 (local address 127.24.71.252:34959)
0808 09:58:21.132580 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.132590 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.132653 (+ 63us) server_negotiation.cc:407] Connection header received
0808 09:58:21.133336 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.133346 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.133414 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.133622 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.134446 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.135733 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.136830 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.137223 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.137348 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.140301 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.140310 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.140310 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.140335 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.142076 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.142371 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.142374 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.142374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.142475 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.142688 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.142689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.142689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.142950 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.143075 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.143168 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.143302 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":188,"thread_start_us":92,"threads_started":1}
I20260808 09:58:21.144240 2377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.252@KRBTEST.COM for oryx/127.24.71.253@KRBTEST.COM
I20260808 09:58:21.151105 2280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.144595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41676 (local address 127.24.71.253:39277)
0808 09:58:21.144647 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.144649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.144658 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:21.144682 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.144683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.144697 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.144743 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.145013 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.145509 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.146185 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.146414 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.146502 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.148313 (+ 1811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.148315 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.148315 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.148324 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.149853 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.150234 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.150235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.150235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.150299 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.150521 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.150522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.150522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.150665 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.150742 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.150918 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.151017 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 09:58:21.151103 2383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.144537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:39277 (local address 127.0.0.1:41676)
0808 09:58:21.144582 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.144592 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.144629 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.144755 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.144755 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.144889 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.144933 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.144934 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.145594 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.145595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.146100 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.146102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.146502 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.146503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.146572 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.147007 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.147013 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.148209 (+ 1196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.149972 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.149973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.149973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.150155 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.150375 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.150375 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.150376 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.150450 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.150745 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.150747 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.150794 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.150881 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.150995 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 09:58:21.151732 2377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.252@KRBTEST.COM for oryx/127.24.71.252@KRBTEST.COM
I20260808 09:58:21.158329 2383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.152016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:34959 (local address 127.0.0.1:54790)
0808 09:58:21.152067 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.152078 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.152116 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.152229 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.152230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.152371 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.152410 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.152411 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.153067 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.153068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.153548 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.153549 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.153935 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.153937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.153984 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.154436 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.154441 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.155646 (+ 1205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.157287 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.157288 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.157288 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.157460 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.157669 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.157670 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.157671 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.157726 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.157984 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.157985 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.158025 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.158113 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.158213 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 09:58:21.158377 2381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.152090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54790 (local address 127.24.71.252:34959)
0808 09:58:21.152133 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.152135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.152143 (+ 8us) server_negotiation.cc:407] Connection header received
0808 09:58:21.152163 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.152164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.152173 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.152225 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.152483 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.152969 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.153630 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.153848 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.153939 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.155733 (+ 1794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.155734 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.155734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.155742 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.157184 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.157546 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.157547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.157547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.157601 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.157797 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.157798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.157799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.157918 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.157993 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.158139 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.158263 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":27}
I20260808 09:58:21.159965 2377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: Bootstrap starting.
I20260808 09:58:21.160823 2377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:21.161068 2377 log.cc:824] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:21.161818 2377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: No bootstrap required, opened a new log
I20260808 09:58:21.163244 2377 raft_consensus.cc:348] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } }
I20260808 09:58:21.163376 2377 raft_consensus.cc:374] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:21.163508 2377 raft_consensus.cc:729] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda4746da1f7494b8cd2c141fab95e92, State: Initialized, Role: FOLLOWER
I20260808 09:58:21.163614 2377 consensus_queue.cc:260] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } }
I20260808 09:58:21.163875 2386 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } } }
I20260808 09:58:21.163962 2377 sys_catalog.cc:564] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:21.163983 2386 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 09:58:21.165686 2404 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 09:58:21.165769 2404 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 09:58:21.168437 2286 master_runner.cc:428] Detected that this master bda4746da1f7494b8cd2c141fab95e92 is joining an existing cluster
I20260808 09:58:21.168481 2286 master_runner.cc:432] Initiating AddMaster RPC to add 127.24.71.252:34959
I20260808 09:58:21.195432 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 1428
I20260808 09:58:21.195988 2280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.170216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41678 (local address 127.24.71.253:39277)
0808 09:58:21.170331 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.170333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.170344 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:58:21.170370 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.170371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.170382 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.170449 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.170912 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.171640 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.172869 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.173165 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.173217 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.192578 (+ 19361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.192581 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.192581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.192591 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.194562 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.195003 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.195004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.195005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.195064 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.195275 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.195276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.195276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.195457 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.195504 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.195735 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.195844 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 09:58:21.196373 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.169800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:39277 (local address 127.0.0.1:41678)
0808 09:58:21.169931 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.169939 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.169977 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.170504 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.170505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.170744 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.170804 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.170806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.171751 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.171752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.172769 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.172771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.173341 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.173342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.173416 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.173831 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.173835 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.192418 (+ 18583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.194648 (+ 2230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.194648 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.194649 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.194912 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.195142 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.195143 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.195143 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.195202 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.195555 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.195555 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.195606 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.196124 (+ 518us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.196253 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":43,"thread_start_us":90,"threads_started":1}
I20260808 09:58:21.196527 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.169632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50118 (local address 127.24.71.254:41105)
0808 09:58:21.169690 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.169692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.169774 (+ 82us) server_negotiation.cc:407] Connection header received
0808 09:58:21.169847 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.169848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.169863 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.169930 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.170504 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.171285 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.172428 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.172734 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.172782 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.192578 (+ 19796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.192581 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.192581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.192591 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.194448 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.195654 (+ 1206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.195655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.195655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.195716 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.195939 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.195940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.195941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.196076 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.196132 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.196329 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.196411 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 09:58:21.196847 2411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.169521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50118)
0808 09:58:21.169704 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.169717 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.169784 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.169987 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.169989 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.170294 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.170399 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.170402 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.171413 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.171414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.172321 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.172324 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.172885 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.172886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.172947 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.173446 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.173451 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.192418 (+ 18967us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.194559 (+ 2141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.194560 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.194561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.195565 (+ 1004us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.195791 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.195792 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.195793 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.195850 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.196165 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.196165 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.196203 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.196641 (+ 438us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.196753 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":115,"threads_started":1}
I20260808 09:58:21.206418 2381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.170277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54804 (local address 127.24.71.252:34959)
0808 09:58:21.170314 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.170316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.170322 (+ 6us) server_negotiation.cc:407] Connection header received
0808 09:58:21.170339 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.170340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.170348 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.170392 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.170955 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.171687 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.172736 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.173043 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.173085 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.192778 (+ 19693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.192779 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.192780 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.192786 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.195328 (+ 2542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.205661 (+ 10333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.205662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.205662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.205716 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.205866 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.205867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.205867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.205981 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.206016 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.206182 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.206268 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 09:58:21.207007 2413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.170011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:34959 (local address 127.0.0.1:54804)
0808 09:58:21.170141 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.170150 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.170204 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.170560 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.170561 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.170789 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.170853 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.170855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.171777 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.171777 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.172645 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.172648 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.173184 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.173185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.173242 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.192082 (+ 18840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.192089 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.192664 (+ 575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.205235 (+ 12571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.205236 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.205236 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.205447 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.205773 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.205773 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.205774 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.205816 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.206052 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.206053 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.206089 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.206698 (+ 609us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.206830 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":46,"thread_start_us":73,"threads_started":1}
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183100, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.254@KRBTEST.COM for oryx/127.24.71.252@KRBTEST.COM
I20260808 09:58:21.213658 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:38263
--local_ip_for_outbound_sockets=127.24.71.193
--tserver_master_addrs=127.24.71.254:41105
--webserver_port=33863
--webserver_interface=127.24.71.193
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab
--principal=oryx/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.71.254:41105,127.24.71.253:39277
--tserver_master_addrs=127.24.71.254:41105,127.24.71.253:39277,127.24.71.252:34959 with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 09:58:21.216188 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.199217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:34959 (local address 127.0.0.1:54818)
0808 09:58:21.206290 (+ 7073us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.206303 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.206360 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.208453 (+ 2093us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.208455 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.208636 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.208689 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.208691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.209360 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.209361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.209967 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.209969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.210308 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.210309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.210375 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.210854 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.210860 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.212142 (+ 1282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.215135 (+ 2993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.215136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.215136 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.215295 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.215532 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.215533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.215533 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.215593 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.215855 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.215857 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.215903 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.215980 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.216091 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7048}
I20260808 09:58:21.216187 2381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.206469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54818 (local address 127.24.71.252:34959)
0808 09:58:21.206509 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.206511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.206520 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:21.206565 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.206567 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.206580 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.206648 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.208785 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.209266 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.210058 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.210237 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.210318 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.212236 (+ 1918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.212237 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.212237 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.212244 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.213889 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.215426 (+ 1537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.215427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.215428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.215483 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.215663 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.215664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.215664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.215776 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.215850 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.216019 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.216088 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22,"thread_start_us":2085,"threads_started":1}
I20260808 09:58:21.216681 1343 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.24.71.252:34959: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92"
member_type: NON_VOTER
last_known_addr {
host: "127.24.71.252"
port: 34959
}
attrs {
promote: true
}
}
dest_uuid: "521226152b5048e4a97fd2c5782a30dd"
cas_config_opid_index: 5
I20260808 09:58:21.216984 1343 consensus_queue.cc:237] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } }
I20260808 09:58:21.217522 2152 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER bda4746da1f7494b8cd2c141fab95e92 (127.24.71.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } } }
I20260808 09:58:21.218473 2152 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.24.71.252:34959
I20260808 09:58:21.218565 2152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } } }
I20260808 09:58:21.218654 2152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:21.219035 2343 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:21.219058 2286 master.cc:537] Master@127.24.71.252:34959 shutting down...
I20260808 09:58:21.220142 2343 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 FOLLOWER]: Refusing update from remote peer 521226152b5048e4a97fd2c5782a30dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 09:58:21.221946 2423 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 09:58:21.223357 1321 consensus_peers.cc:487] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd -> Peer bda4746da1f7494b8cd2c141fab95e92 (127.24.71.252:34959): Couldn't send request to peer bda4746da1f7494b8cd2c141fab95e92. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 09:58:21.225013 2286 raft_consensus.cc:2229] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:21.225100 2286 raft_consensus.cc:2258] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:21.225144 2286 tablet_replica.cc:330] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: stopping tablet replica
I20260808 09:58:21.226557 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.218878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:39277 (local address 127.0.0.1:41688)
0808 09:58:21.219085 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.219097 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.219138 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.221268 (+ 2130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.221270 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.221272 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:21.221324 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.221325 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.222918 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.222920 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.225431 (+ 2511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.225434 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.226313 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.226314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.226362 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.226376 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.226450 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.226490 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187}
I20260808 09:58:21.226557 2280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.219539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41688 (local address 127.24.71.253:39277)
0808 09:58:21.219581 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.219584 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.219591 (+ 7us) server_negotiation.cc:407] Connection header received
0808 09:58:21.219617 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.219618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.219641 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.219703 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:21.221417 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.222167 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.225543 (+ 3376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.226162 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.226204 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.226262 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.226455 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.226492 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 09:58:21.226823 2222 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 LEARNER]: Refusing update from remote peer 521226152b5048e4a97fd2c5782a30dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 09:58:21.227005 2423 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 09:58:21.227744 2222 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER bda4746da1f7494b8cd2c141fab95e92 (127.24.71.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } } }
I20260808 09:58:21.229009 2262 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 521226152b5048e4a97fd2c5782a30dd. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } } }
I20260808 09:58:21.229091 2262 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: This master's current role is: LEARNER
I20260808 09:58:21.229131 2262 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: NON_VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: true } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } } }
I20260808 09:58:21.229169 2262 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: This master's current role is: LEARNER
I20260808 09:58:21.229166 2153 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd: attempting to promote NON_VOTER bdfd5bbc5cad4546a5bbeccce71a8809 to VOTER
I20260808 09:58:21.229355 2153 consensus_queue.cc:237] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } }
I20260808 09:58:21.229468 2286 master.cc:552] Master@127.24.71.252:34959 shutdown complete.
I20260808 09:58:21.229507 2286 master_runner.cc:305] Clearing existing system tablet
I20260808 09:58:21.229650 2286 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:21.229700 2286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:21.229856 2222 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 LEARNER]: Refusing update from remote peer 521226152b5048e4a97fd2c5782a30dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 09:58:21.229966 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.229857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:34959 (local address 127.0.0.1:54822)
0808 09:58:21.229896 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.229938 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:34959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 09:58:21.230109 2423 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 09:58:21.230278 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.230204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:34959 (local address 127.0.0.1:54828)
0808 09:58:21.230234 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.230254 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:34959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260808 09:58:21.230332 1321 consensus_peers.cc:487] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd -> Peer bda4746da1f7494b8cd2c141fab95e92 (127.24.71.252:34959): Couldn't send request to peer bda4746da1f7494b8cd2c141fab95e92. Status: Network error: Client connection negotiation failed: client connection to 127.24.71.252:34959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 09:58:21.230778 2152 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, bdfd5bbc5cad4546a5bbeccce71a8809 (127.24.71.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } } }
I20260808 09:58:21.231575 2152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } } }
I20260808 09:58:21.231654 2152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:21.231642 2286 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 09:58:21.231714 2152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } } }
I20260808 09:58:21.231762 2152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:21.232085 2222 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, bdfd5bbc5cad4546a5bbeccce71a8809 (127.24.71.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } } }
I20260808 09:58:21.232174 2432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:21.232268 2286 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:21.232321 2286 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:21.232345 2286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/wal
uuid: "bda4746da1f7494b8cd2c141fab95e92"
format_stamp: "Formatted at 2026-08-08 09:58:21 on dist-test-slave-gw5c"
server_key: "2c565b2e1bee5da68650de0e638a0116"
server_key_iv: "34d9fecd422e3d1810324e00616d11c3"
server_key_version: "encryptionkey@0"
I20260808 09:58:21.233136 2286 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:21.233119 2429 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } } }
I20260808 09:58:21.233238 2429 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 09:58:21.234511 2286 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 09:58:21.234584 2286 log.cc:1196] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 09:58:21.234777 2286 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: Deleting consensus metadata
I20260808 09:58:21.234926 2286 master_runner.cc:315] Copying system tablet from 127.24.71.254:41105
I20260808 09:58:21.235728 2286 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: tablet copy: Beginning tablet copy session from remote peer at address 127.24.71.254:41105
I20260808 09:58:21.243196 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.236062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50132 (local address 127.24.71.254:41105)
0808 09:58:21.236104 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.236106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.236234 (+ 128us) server_negotiation.cc:407] Connection header received
0808 09:58:21.236294 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.236314 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.236325 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.236393 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.236719 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.237503 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.238607 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.238917 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.238998 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.240201 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.240202 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.240202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.240210 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.241870 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.242272 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.242273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.242273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.242335 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.242571 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.242572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.242572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.242733 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.242804 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.242978 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.243057 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 09:58:21.243232 2438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.236005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50132)
0808 09:58:21.236163 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.236173 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.236230 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.236396 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.236397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.236597 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.236644 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.236646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.237587 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.237589 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.238473 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.238475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.239010 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.239011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.239075 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.239682 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.239687 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.240100 (+ 413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.241959 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.241960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.241960 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.242192 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.242409 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.242410 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.242410 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.242479 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.242804 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.242805 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.242852 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.242932 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.243036 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":72,"threads_started":1}
I20260808 09:58:21.243762 1372 tablet_copy_service.cc:140] P 521226152b5048e4a97fd2c5782a30dd: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer bda4746da1f7494b8cd2c141fab95e92 ({username='oryx', principal='oryx/127.24.71.252@KRBTEST.COM'} at 127.0.0.1:50132)
I20260808 09:58:21.243832 1372 tablet_copy_service.cc:161] P 521226152b5048e4a97fd2c5782a30dd: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer bda4746da1f7494b8cd2c141fab95e92 at {username='oryx', principal='oryx/127.24.71.252@KRBTEST.COM'} at 127.0.0.1:50132: session id = bda4746da1f7494b8cd2c141fab95e92-00000000000000000000000000000000
I20260808 09:58:21.244462 1372 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 09:58:21.245049 2286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 09:58:21.246340 2286 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: tablet copy: Starting download of 0 data blocks...
I20260808 09:58:21.246500 2286 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: tablet copy: Starting download of 1 WAL segments...
I20260808 09:58:21.247234 2286 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 09:58:21.248152 1372 tablet_copy_service.cc:342] P 521226152b5048e4a97fd2c5782a30dd: Request end of tablet copy session bda4746da1f7494b8cd2c141fab95e92-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.24.71.252@KRBTEST.COM'} at 127.0.0.1:50132
I20260808 09:58:21.248210 1372 tablet_copy_service.cc:433] P 521226152b5048e4a97fd2c5782a30dd: ending tablet copy session bda4746da1f7494b8cd2c141fab95e92-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer bda4746da1f7494b8cd2c141fab95e92
I20260808 09:58:21.250977 2286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:21.252162 2440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:21.252219 2444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:21.252746 2441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:21.252996 2286 server_base.cc:1034] running on GCE node
I20260808 09:58:21.253202 2286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:21.253347 2286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:21.254474 2286 hybrid_clock.cc:648] HybridClock initialized: now 1786183101254466 us; error 25 us; skew 500 ppm
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:21.256160 2286 init.cc:377] Logged in from keytab as oryx/127.24.71.252@KRBTEST.COM (short username oryx)
I20260808 09:58:21.256421 2286 webserver.cc:460] Webserver started at http://127.24.71.252:33449/ using document root <none> and password file <none>
I20260808 09:58:21.256532 2286 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:21.256558 2286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:21.257285 2286 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:21.257936 2458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:21.258127 2286 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 09:58:21.258178 2286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/wal
uuid: "bda4746da1f7494b8cd2c141fab95e92"
format_stamp: "Formatted at 2026-08-08 09:58:21 on dist-test-slave-gw5c"
server_key: "2c565b2e1bee5da68650de0e638a0116"
server_key_iv: "34d9fecd422e3d1810324e00616d11c3"
server_key_version: "encryptionkey@0"
I20260808 09:58:21.258234 2286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:21.270499 2286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:21.272689 2286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:21.276052 2286 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.252:34959
I20260808 09:58:21.276342 2541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.252:34959 every 8 connection(s)
I20260808 09:58:21.276471 2286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/master-2/data/info.pb
I20260808 09:58:21.277396 2542 sys_catalog.cc:263] Verifying existing consensus state
I20260808 09:58:21.277894 2542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: Bootstrap starting.
I20260808 09:58:21.281071 2542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 09:58:21.281316 2542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: Bootstrap complete.
I20260808 09:58:21.281536 2542 raft_consensus.cc:348] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } }
I20260808 09:58:21.281641 2542 raft_consensus.cc:729] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bda4746da1f7494b8cd2c141fab95e92, State: Initialized, Role: LEARNER
I20260808 09:58:21.281688 2542 consensus_queue.cc:260] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } }
I20260808 09:58:21.281877 2546 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } } }
I20260808 09:58:21.282002 2546 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: This master's current role is: LEARNER
I20260808 09:58:21.281881 2542 sys_catalog.cc:564] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:21.283658 2563 catalog_manager.cc:1259] Loaded cluster ID: 1f5eee97dbf44a56a4835990db82703a
I20260808 09:58:21.283759 2563 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: loading cluster ID for follower catalog manager: success
I20260808 09:58:21.284978 2563 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: acquiring CA information for follower catalog manager: success
I20260808 09:58:21.285280 2563 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 09:58:21.318707 2415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:21.318933 2415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:21.318956 2415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:21.320264 2415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:21.320312 2415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:21.320348 2415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:21.321969 2415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab
--principal=oryx/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:38263
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=33863
--tserver_master_addrs=127.24.71.254:41105,127.24.71.253:39277,127.24.71.252:34959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:21.322218 2415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:21.322492 2415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:21.328652 2576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:21.328625 2579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:21.328647 2577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:21.329044 2415 server_base.cc:1034] running on GCE node
I20260808 09:58:21.329239 2415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:21.329515 2415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:21.330688 2415 hybrid_clock.cc:648] HybridClock initialized: now 1786183101330673 us; error 34 us; skew 500 ppm
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:21.333626 2415 init.cc:377] Logged in from keytab as oryx/127.24.71.193@KRBTEST.COM (short username oryx)
I20260808 09:58:21.334125 2415 webserver.cc:460] Webserver started at http://127.24.71.193:33863/ using document root <none> and password file <none>
I20260808 09:58:21.334367 2415 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:21.334508 2415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:21.336262 2415 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:21.336962 2586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:21.337183 2415 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:21.337275 2415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "598eca03628e46919b5f8eecd58e7b38"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "a0ccadd637e3582f7d9f5192e4e524f2"
server_key_iv: "4cdfe9a1990fbfcd793ae392c29d0455"
server_key_version: "encryptionkey@0"
I20260808 09:58:21.337693 2415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:21.360386 2415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:21.362320 2415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:21.362447 2415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:21.362653 2415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:21.363005 2415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:21.363041 2415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:21.363066 2415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:21.363103 2415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:21.369192 2415 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:38263
I20260808 09:58:21.369270 2760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:38263 every 8 connection(s)
I20260808 09:58:21.369645 2415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 09:58:21.370682 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 2415
I20260808 09:58:21.370865 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 1626
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.253@KRBTEST.COM
I20260808 09:58:21.389895 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:37603
--local_ip_for_outbound_sockets=127.24.71.194
--tserver_master_addrs=127.24.71.254:41105
--webserver_port=41659
--webserver_interface=127.24.71.194
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab
--principal=oryx/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.71.254:41105,127.24.71.253:39277
--tserver_master_addrs=127.24.71.254:41105,127.24.71.253:39277,127.24.71.252:34959 with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 09:58:21.390005 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.370816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:41323 (local address 127.24.71.254:41105)
0808 09:58:21.370867 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.370870 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.374899 (+ 4029us) server_negotiation.cc:407] Connection header received
0808 09:58:21.375008 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.375009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.375024 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.375055 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.376180 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.376981 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.378458 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.378752 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.378792 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.385179 (+ 6387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.385182 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.385182 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.385192 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.387738 (+ 2546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.388326 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.388328 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.388328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.388401 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.388984 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.388986 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.388986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.389156 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.389226 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.389799 (+ 573us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.389893 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 09:58:21.390700 2767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.370725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.193:41323)
0808 09:58:21.374836 (+ 4111us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.374847 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.374929 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.375212 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.375217 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.375851 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.376062 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.376067 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.377108 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.377109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.378350 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.378352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.378885 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.378886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.379062 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.382973 (+ 3911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.382985 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.385035 (+ 2050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.387879 (+ 2844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.387888 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.387890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.388226 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.388731 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.388732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.388733 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.388898 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.389424 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.389432 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.389609 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.389716 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.389899 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4093,"thread_start_us":63,"threads_started":1}
I20260808 09:58:21.391340 2761 heartbeater.cc:347] Connected to a master server at 127.24.71.254:41105
I20260808 09:58:21.391551 2761 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:21.391872 2761 heartbeater.cc:511] Master 127.24.71.254:41105 requested a full tablet report, sending...
I20260808 09:58:21.392371 1343 ts_manager.cc:194] Re-registered known tserver with Master: 598eca03628e46919b5f8eecd58e7b38 (127.24.71.193:38263)
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.252@KRBTEST.COM
I20260808 09:58:21.392508 2280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.370961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:54039 (local address 127.24.71.253:39277)
0808 09:58:21.373430 (+ 2469us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.373432 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.376285 (+ 2853us) server_negotiation.cc:407] Connection header received
0808 09:58:21.376381 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.376382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.376395 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.376438 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.376842 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.377551 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.378555 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.378845 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.378884 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.386997 (+ 8113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.386999 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.386999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.387008 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.389315 (+ 2307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.391023 (+ 1708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.391025 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.391025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.391093 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.391966 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.391967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.391967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.392109 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.392150 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.392336 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.392420 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2441}
I20260808 09:58:21.392863 2766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.370888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:39277 (local address 127.24.71.193:54039)
0808 09:58:21.376227 (+ 5339us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.376237 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.376312 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.376502 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.376503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.376688 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.376759 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.376761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.377652 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.377652 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.378472 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.378474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.378954 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.378955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.379062 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.385539 (+ 6477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.385550 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.386870 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.390345 (+ 3475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.390345 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.390346 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.390575 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.391817 (+ 1242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.391818 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.391818 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.391875 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.392194 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.392195 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.392237 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.392615 (+ 378us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.392761 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5325,"mutex_wait_us":3,"thread_start_us":64,"threads_started":1}
I20260808 09:58:21.392887 1343 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:41323
I20260808 09:58:21.393235 2763 heartbeater.cc:347] Connected to a master server at 127.24.71.253:39277
I20260808 09:58:21.393296 2763 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:21.393368 2763 heartbeater.cc:511] Master 127.24.71.253:39277 requested a full tablet report, sending...
I20260808 09:58:21.393795 2204 ts_manager.cc:194] Registered new tserver with Master: 598eca03628e46919b5f8eecd58e7b38 (127.24.71.193:38263)
I20260808 09:58:21.396952 2765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.370423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:35011 (local address 127.24.71.252:34959)
0808 09:58:21.370595 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.370598 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.373963 (+ 3365us) server_negotiation.cc:407] Connection header received
0808 09:58:21.385369 (+ 11406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.385371 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.385389 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.386396 (+ 1007us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.386455 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.387564 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.389940 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.390274 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.390936 (+ 662us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.392896 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.392897 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.392898 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.392906 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.395677 (+ 2771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.396016 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.396018 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.396019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.396090 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.396334 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.396335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.396336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.396500 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.396570 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.396710 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.396812 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260808 09:58:21.397032 2768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.370430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:34959 (local address 127.24.71.193:35011)
0808 09:58:21.373790 (+ 3360us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.373847 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.374651 (+ 804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.386068 (+ 11417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.386069 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.386223 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.386309 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.386311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.387698 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.387699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.389835 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.389838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.390679 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.390680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.390758 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.391204 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.391210 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.392797 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.395764 (+ 2967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.395765 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.395765 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.395936 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.396190 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.396191 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.396192 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.396261 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.396575 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.396576 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.396610 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.396659 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.396743 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3310,"thread_start_us":81,"threads_started":1}
I20260808 09:58:21.397715 2762 heartbeater.cc:347] Connected to a master server at 127.24.71.252:34959
I20260808 09:58:21.397773 2762 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:21.397855 2762 heartbeater.cc:511] Master 127.24.71.252:34959 requested a full tablet report, sending...
I20260808 09:58:21.398253 2485 ts_manager.cc:194] Registered new tserver with Master: 598eca03628e46919b5f8eecd58e7b38 (127.24.71.193:38263)
W20260808 09:58:21.477525 2769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:21.477845 2769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:21.477936 2769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:21.479158 2769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:21.479236 2769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:21.479281 2769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:21.480825 2769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab
--principal=oryx/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:37603
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=41659
--tserver_master_addrs=127.24.71.254:41105,127.24.71.253:39277,127.24.71.252:34959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:21.481184 2769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:21.481432 2769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:21.486878 2776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:21.486858 2775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:21.486860 2769 server_base.cc:1034] running on GCE node
W20260808 09:58:21.486896 2782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:21.487360 2769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:21.487673 2769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:21.488853 2769 hybrid_clock.cc:648] HybridClock initialized: now 1786183101488839 us; error 31 us; skew 500 ppm
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:21.495630 2769 init.cc:377] Logged in from keytab as oryx/127.24.71.194@KRBTEST.COM (short username oryx)
I20260808 09:58:21.496094 2769 webserver.cc:460] Webserver started at http://127.24.71.194:41659/ using document root <none> and password file <none>
I20260808 09:58:21.496340 2769 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:21.496443 2769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:21.497844 2769 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:21.498431 2790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:21.498632 2769 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 09:58:21.498729 2769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "83edd72a23b543e0aa22dad2db0ca8bd"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "dd22a5fc7cc0feb98c2782a415d0626b"
server_key_iv: "15f7f999eb6e66df1d87ff81ffb845a6"
server_key_version: "encryptionkey@0"
I20260808 09:58:21.499097 2769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:21.516368 2769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:21.518832 2769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:21.519033 2769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:21.519327 2769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:21.519701 2769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:21.519760 2769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:21.519806 2769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:21.519835 2769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:21.525987 2769 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:37603
I20260808 09:58:21.526067 2956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:37603 every 8 connection(s)
I20260808 09:58:21.526443 2769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:58:21.528358 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 2769
I20260808 09:58:21.528535 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 1817
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.252@KRBTEST.COM
I20260808 09:58:21.544606 2765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.527232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:49747 (local address 127.24.71.252:34959)
0808 09:58:21.527341 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.527345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.527560 (+ 215us) server_negotiation.cc:407] Connection header received
0808 09:58:21.528319 (+ 759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.528320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.528335 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.528399 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.535828 (+ 7429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.536497 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.537866 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.538145 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.538182 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.540875 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.540876 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.540877 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.540884 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.542643 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.543284 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.543285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.543285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.543342 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.543709 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.543710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.543711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.543872 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.543958 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.544380 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.544474 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 09:58:21.545043 2961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.527210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:34959 (local address 127.24.71.194:49747)
0808 09:58:21.527422 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.527472 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.528136 (+ 664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.528479 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.528483 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.535107 (+ 6624us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.535735 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.535736 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.536614 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.536615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.537762 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.537765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.538264 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.538265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.538398 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.538994 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.539003 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.540760 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.542742 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.542753 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.542756 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.543180 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.543440 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.543441 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.543441 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.543629 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.543950 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.543959 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.544191 (+ 232us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.544348 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.544598 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":93,"threads_started":1}
I20260808 09:58:21.545732 2958 heartbeater.cc:347] Connected to a master server at 127.24.71.252:34959
I20260808 09:58:21.545862 2958 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:21.546134 2958 heartbeater.cc:511] Master 127.24.71.252:34959 requested a full tablet report, sending...
I20260808 09:58:21.546654 2485 ts_manager.cc:194] Registered new tserver with Master: 83edd72a23b543e0aa22dad2db0ca8bd (127.24.71.194:37603)
I20260808 09:58:21.557420 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:36949
--local_ip_for_outbound_sockets=127.24.71.195
--tserver_master_addrs=127.24.71.254:41105
--webserver_port=44313
--webserver_interface=127.24.71.195
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab
--principal=oryx/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.71.254:41105,127.24.71.253:39277
--tserver_master_addrs=127.24.71.254:41105,127.24.71.253:39277,127.24.71.252:34959 with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.253@KRBTEST.COM
I20260808 09:58:21.563027 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.528105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:38503 (local address 127.24.71.254:41105)
0808 09:58:21.528149 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.528151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.528159 (+ 8us) server_negotiation.cc:407] Connection header received
0808 09:58:21.528382 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.528384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.528395 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.528450 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.554381 (+ 25931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.555191 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.556372 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.556636 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.556725 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.559724 (+ 2999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.559725 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.559726 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.559735 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.561569 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.562056 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.562057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.562058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.562117 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.562379 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.562380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.562380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.562552 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.562626 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.562831 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.562923 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 09:58:21.563081 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.527815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.194:38503)
0808 09:58:21.527961 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.527971 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.528221 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.553989 (+ 25768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.553991 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.554165 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.554227 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.554229 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.555311 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.555313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.556250 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.556254 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.556723 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.556724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.556818 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.557377 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.557382 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.559628 (+ 2246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.561668 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.561670 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.561670 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.561938 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.562193 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.562194 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.562194 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.562251 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.562627 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.562628 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.562681 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.562756 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.562892 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":1,"thread_start_us":72,"threads_started":1}
I20260808 09:58:21.563089 2280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.528048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:44743 (local address 127.24.71.253:39277)
0808 09:58:21.528098 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.528100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.528110 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:21.528246 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.528247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.528261 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.528316 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.554519 (+ 26203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.555230 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.556558 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.556833 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.556899 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.560191 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.560193 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.560193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.560204 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.561731 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.562176 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.562177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.562177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.562235 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.562477 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.562478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.562478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.562612 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.562669 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.562923 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.562997 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 09:58:21.563426 2963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.527615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:39277 (local address 127.24.71.194:44743)
0808 09:58:21.527762 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.527772 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.528143 (+ 371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.528478 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.528483 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.535566 (+ 7083us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.535629 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.535636 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.555316 (+ 19680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.555317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.556455 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.556457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.556962 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.556963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.557024 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.557551 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.557556 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.560090 (+ 2534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.561818 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.561819 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.561820 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.562080 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.562308 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.562309 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.562309 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.562381 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.562696 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.562697 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.562761 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.562821 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.563262 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":667,"thread_start_us":94,"threads_started":1}
I20260808 09:58:21.564800 2959 heartbeater.cc:347] Connected to a master server at 127.24.71.253:39277
I20260808 09:58:21.564836 2957 heartbeater.cc:347] Connected to a master server at 127.24.71.254:41105
I20260808 09:58:21.564872 2959 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:21.564889 2957 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:21.564967 2957 heartbeater.cc:511] Master 127.24.71.254:41105 requested a full tablet report, sending...
I20260808 09:58:21.564970 2959 heartbeater.cc:511] Master 127.24.71.253:39277 requested a full tablet report, sending...
I20260808 09:58:21.565244 1343 ts_manager.cc:194] Re-registered known tserver with Master: 83edd72a23b543e0aa22dad2db0ca8bd (127.24.71.194:37603)
I20260808 09:58:21.565347 2204 ts_manager.cc:194] Registered new tserver with Master: 83edd72a23b543e0aa22dad2db0ca8bd (127.24.71.194:37603)
I20260808 09:58:21.565824 1343 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:38503
W20260808 09:58:21.643227 2965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:21.643471 2965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:21.643498 2965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:21.644827 2965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:21.644876 2965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:21.644910 2965 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:21.646350 2965 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab
--principal=oryx/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:36949
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=44313
--tserver_master_addrs=127.24.71.254:41105,127.24.71.253:39277,127.24.71.252:34959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:21.646554 2965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:21.646742 2965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:21.651868 2972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:21.651857 2977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:21.651867 2974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:21.652251 2965 server_base.cc:1034] running on GCE node
I20260808 09:58:21.652441 2965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:21.652633 2965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:21.653771 2965 hybrid_clock.cc:648] HybridClock initialized: now 1786183101653752 us; error 38 us; skew 500 ppm
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:21.656340 2965 init.cc:377] Logged in from keytab as oryx/127.24.71.195@KRBTEST.COM (short username oryx)
I20260808 09:58:21.656746 2965 webserver.cc:460] Webserver started at http://127.24.71.195:44313/ using document root <none> and password file <none>
I20260808 09:58:21.656957 2965 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:21.657011 2965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:21.658383 2965 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:21.658983 2986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:21.659209 2965 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:21.659351 2965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "a549b4bf061f4cc88df1bca82e670696"
format_stamp: "Formatted at 2026-08-08 09:58:20 on dist-test-slave-gw5c"
server_key: "6c89fce03481fb8affaaff9157dd745b"
server_key_iv: "91955de36e2ed561549b7a16a2761d8c"
server_key_version: "encryptionkey@0"
I20260808 09:58:21.659744 2965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:21.675652 2965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:21.678355 2965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:21.678531 2965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:21.678833 2965 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:21.679234 2965 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:21.679277 2965 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:21.679303 2965 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:21.679318 2965 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:21.686280 2965 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:36949
I20260808 09:58:21.686333 3150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:36949 every 8 connection(s)
I20260808 09:58:21.686729 2965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:58:21.694077 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 2965
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.252@KRBTEST.COM
Aug 08 09:58:21 dist-test-slave-gw5c krb5kdc[1280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183101, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.253@KRBTEST.COM
I20260808 09:58:21.699070 3157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.687775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:34959 (local address 127.24.71.195:52613)
0808 09:58:21.687894 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.687904 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.688955 (+ 1051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.689223 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.689227 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.689686 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.689892 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.689897 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.690615 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.690617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.691858 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.691860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.692366 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.692367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.692499 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.693234 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.693238 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.695468 (+ 2230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.697417 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.697425 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.697428 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.697736 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.697962 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.697963 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.697963 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.698088 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.698359 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.698365 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.698524 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.698635 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.698803 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":2,"thread_start_us":71,"threads_started":1}
I20260808 09:58:21.699520 2765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.687890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:52613 (local address 127.24.71.252:34959)
0808 09:58:21.687943 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.687945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.687956 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:58:21.689069 (+ 1113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.689070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.689083 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.689148 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.689999 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.690507 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.691966 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.692232 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.692268 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.695571 (+ 3303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.695572 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.695573 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.695581 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.697333 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.697821 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.697822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.697823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.697884 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.698151 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.698152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.698152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.698274 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.698333 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.699327 (+ 994us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.699432 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 09:58:21.699934 3152 heartbeater.cc:347] Connected to a master server at 127.24.71.252:34959
I20260808 09:58:21.700039 3152 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:21.700240 3152 heartbeater.cc:511] Master 127.24.71.252:34959 requested a full tablet report, sending...
I20260808 09:58:21.700735 2485 ts_manager.cc:194] Registered new tserver with Master: a549b4bf061f4cc88df1bca82e670696 (127.24.71.195:36949)
I20260808 09:58:21.700891 3156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.687537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.195:32957)
0808 09:58:21.687705 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.687750 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.688955 (+ 1205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.689231 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.689232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.689730 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.689893 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.689901 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.691235 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.691236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.692011 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.692013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.692489 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.692490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.692560 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.693310 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.693316 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.694972 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.699117 (+ 4145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.699118 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.699118 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.699328 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.700122 (+ 794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.700122 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.700123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.700185 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.700519 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.700520 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.700565 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.700635 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.700737 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":8,"thread_start_us":74,"threads_started":1}
I20260808 09:58:21.701205 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.687532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:32957 (local address 127.24.71.254:41105)
0808 09:58:21.687607 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.687609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.687877 (+ 268us) server_negotiation.cc:407] Connection header received
0808 09:58:21.689097 (+ 1220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.689099 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.689114 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.689152 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.690018 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.690795 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.692089 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.692410 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.692490 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.695090 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.695091 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.695092 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.695100 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.697162 (+ 2062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.699925 (+ 2763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.699927 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.699927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.699992 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.700250 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.700251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.700252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.700402 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.700487 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.701018 (+ 531us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.701103 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 09:58:21.701879 3151 heartbeater.cc:347] Connected to a master server at 127.24.71.254:41105
I20260808 09:58:21.701937 3151 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:21.702005 3151 heartbeater.cc:511] Master 127.24.71.254:41105 requested a full tablet report, sending...
I20260808 09:58:21.702037 2280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.688148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:53721 (local address 127.24.71.253:39277)
0808 09:58:21.688194 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.688196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.688206 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:21.689098 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.689100 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.689114 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.689152 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.690018 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.690786 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.691953 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.692249 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.692323 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.697268 (+ 4945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.697270 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.697270 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.697279 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.699026 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.700618 (+ 1592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.700619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.700620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.700678 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.701165 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.701166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.701166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.701297 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.701355 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.701850 (+ 495us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.701924 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 09:58:21.702315 3159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.687954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:39277 (local address 127.24.71.195:53721)
0808 09:58:21.688087 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.688097 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.688957 (+ 860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.689240 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.689240 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.689735 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:21.689894 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.689901 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.690878 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.690879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.691857 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.691859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.692349 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.692351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.692499 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.693223 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:21.693234 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:21.696517 (+ 3283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:21.700264 (+ 3747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.700265 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.700265 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.700537 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.700745 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:21.700746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:21.700746 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:21.700881 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:21.701686 (+ 805us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:21.701687 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:21.701731 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.701806 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.701910 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":136,"thread_start_us":73,"threads_started":1}
I20260808 09:58:21.702360 1343 ts_manager.cc:194] Re-registered known tserver with Master: a549b4bf061f4cc88df1bca82e670696 (127.24.71.195:36949)
I20260808 09:58:21.702631 3154 heartbeater.cc:347] Connected to a master server at 127.24.71.253:39277
I20260808 09:58:21.702682 3154 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:21.702749 3154 heartbeater.cc:511] Master 127.24.71.253:39277 requested a full tablet report, sending...
I20260808 09:58:21.702924 1343 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:32957
I20260808 09:58:21.703027 2204 ts_manager.cc:194] Registered new tserver with Master: a549b4bf061f4cc88df1bca82e670696 (127.24.71.195:36949)
I20260808 09:58:21.705061 3173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.696000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54832 (local address 127.24.71.252:34959)
0808 09:58:21.696485 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.696487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.696765 (+ 278us) server_negotiation.cc:407] Connection header received
0808 09:58:21.696795 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.696796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.696806 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.696874 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.697548 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.698267 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.699288 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.699627 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.699700 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.701305 (+ 1605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.701306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.701306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.701314 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.703491 (+ 2177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.704204 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.704205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.704205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.704263 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.704482 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.704483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.704484 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.704625 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.704730 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.704882 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.704968 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":74,"threads_started":1}
I20260808 09:58:21.708585 3176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.696165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41694 (local address 127.24.71.253:39277)
0808 09:58:21.696691 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.696694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.696703 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:21.697488 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.697489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.697504 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.697563 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.698338 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.699129 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.701827 (+ 2698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.703452 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.703520 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.704938 (+ 1418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.704940 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.704940 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.704948 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.706820 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.707592 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.707593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.707594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.707658 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.707906 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.707907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.707908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.708066 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.708178 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.708356 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.708463 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":60,"threads_started":1}
I20260808 09:58:21.709677 3172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.695753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50140 (local address 127.24.71.254:41105)
0808 09:58:21.696137 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.696139 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.702026 (+ 5887us) server_negotiation.cc:407] Connection header received
0808 09:58:21.702720 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.702721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.702734 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.702808 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.703681 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.704217 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.705233 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.705526 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.705576 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.706949 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.706950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.706950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.706956 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.708706 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.709100 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.709101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.709101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.709159 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.709313 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.709314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.709314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.709409 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.709486 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.709547 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.709614 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":93,"threads_started":1}
I20260808 09:58:21.711113 1343 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:58:21.712772 1343 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:58:21.720371 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.716677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:36949 (local address 127.0.0.1:51720)
0808 09:58:21.716804 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.716828 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.716869 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.717380 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.717381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.717383 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:21.717437 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.717438 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.718502 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.718503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.719448 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.719451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.720124 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.720125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.720184 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.720187 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.720245 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.720292 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109}
I20260808 09:58:21.720579 3190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.716966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51720 (local address 127.24.71.195:36949)
0808 09:58:21.717200 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.717205 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.717216 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:58:21.717257 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.717259 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.717276 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.717383 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:21.717517 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.718415 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.719536 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.720036 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.720126 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.720208 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.720263 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.720301 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":120,"threads_started":1}
I20260808 09:58:21.721259 3057 tablet_service.cc:1467] Processing CreateTablet for tablet 8e77d372b08c4ac88b362d6f87bbcb47 (DEFAULT_TABLE table=test-table [id=e269a34ac15e4171887662e586796d80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:21.721648 3187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.716734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:38263 (local address 127.0.0.1:46096)
0808 09:58:21.717239 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.717250 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.717300 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.717745 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.717746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.717749 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:21.717813 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.717814 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.719032 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.719033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.720355 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.720357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.721372 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.721374 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.721462 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.721467 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.721519 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.721561 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":60,"thread_start_us":89,"threads_started":1}
I20260808 09:58:21.721733 3057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e77d372b08c4ac88b362d6f87bbcb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:21.721961 3192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.716996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46096 (local address 127.24.71.193:38263)
0808 09:58:21.717588 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.717592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.717602 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:21.717638 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.717640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.717653 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.717729 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:21.717877 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.718934 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.720468 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.721189 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.721260 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.721333 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.721833 (+ 500us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.721886 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":91,"threads_started":1}
I20260808 09:58:21.721649 3185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.716741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:37603 (local address 127.0.0.1:59448)
0808 09:58:21.717373 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.717379 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.717453 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.717695 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.717696 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.717699 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:21.717760 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.717762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.719031 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.719033 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.720355 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.720357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.721375 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.721375 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.721465 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.721468 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.721547 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.721580 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"mutex_wait_us":87,"thread_start_us":87,"threads_started":1}
I20260808 09:58:21.722026 3189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.716980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59448 (local address 127.24.71.194:37603)
0808 09:58:21.717185 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.717190 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.717456 (+ 266us) server_negotiation.cc:407] Connection header received
0808 09:58:21.717527 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.717529 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.717546 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.717622 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:21.717821 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.718900 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.720462 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.721187 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.721260 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.721333 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.721692 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.721740 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":98,"threads_started":1}
I20260808 09:58:21.722641 2658 tablet_service.cc:1467] Processing CreateTablet for tablet 8e77d372b08c4ac88b362d6f87bbcb47 (DEFAULT_TABLE table=test-table [id=e269a34ac15e4171887662e586796d80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:21.722986 2658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e77d372b08c4ac88b362d6f87bbcb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:21.723903 2864 tablet_service.cc:1467] Processing CreateTablet for tablet 8e77d372b08c4ac88b362d6f87bbcb47 (DEFAULT_TABLE table=test-table [id=e269a34ac15e4171887662e586796d80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:21.724259 2864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e77d372b08c4ac88b362d6f87bbcb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:21.725910 3194 tablet_bootstrap.cc:492] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696: Bootstrap starting.
I20260808 09:58:21.726298 3195 tablet_bootstrap.cc:492] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38: Bootstrap starting.
I20260808 09:58:21.726634 3194 tablet_bootstrap.cc:654] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:21.726964 3195 tablet_bootstrap.cc:654] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:21.726970 3194 log.cc:824] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:21.727275 3195 log.cc:824] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:21.728035 3194 tablet_bootstrap.cc:492] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696: No bootstrap required, opened a new log
I20260808 09:58:21.728034 3195 tablet_bootstrap.cc:492] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38: No bootstrap required, opened a new log
I20260808 09:58:21.728114 3194 ts_tablet_manager.cc:1397] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 09:58:21.728120 3195 ts_tablet_manager.cc:1397] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 09:58:21.728565 3201 tablet_bootstrap.cc:492] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd: Bootstrap starting.
I20260808 09:58:21.729204 3201 tablet_bootstrap.cc:654] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:21.729684 3201 log.cc:824] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:21.729913 3173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.726134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54844 (local address 127.24.71.252:34959)
0808 09:58:21.726183 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.726186 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.726274 (+ 88us) server_negotiation.cc:407] Connection header received
0808 09:58:21.726380 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.726381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.726405 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.726446 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:21.726640 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.727428 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.728742 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.729387 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.729440 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.729521 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.729755 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.729823 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 09:58:21.730276 3185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.726021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:34959 (local address 127.0.0.1:54844)
0808 09:58:21.726219 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.726231 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.726301 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.726516 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.726517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.726519 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:21.726562 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.726563 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.727536 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.727537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.728636 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.728640 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.729587 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.729588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.729662 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.729665 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.730043 (+ 378us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.730102 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178}
I20260808 09:58:21.730198 3194 raft_consensus.cc:348] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:21.730360 3194 raft_consensus.cc:374] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:21.730399 3194 raft_consensus.cc:729] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a549b4bf061f4cc88df1bca82e670696, State: Initialized, Role: FOLLOWER
I20260808 09:58:21.730530 3201 tablet_bootstrap.cc:492] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd: No bootstrap required, opened a new log
I20260808 09:58:21.730532 3194 consensus_queue.cc:260] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:21.730592 3201 ts_tablet_manager.cc:1397] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:58:21.730684 3195 raft_consensus.cc:348] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:21.730816 3194 ts_tablet_manager.cc:1428] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 09:58:21.730829 3195 raft_consensus.cc:374] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:21.730862 3195 raft_consensus.cc:729] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598eca03628e46919b5f8eecd58e7b38, State: Initialized, Role: FOLLOWER
I20260808 09:58:21.730865 3151 heartbeater.cc:503] Master 127.24.71.254:41105 was elected leader, sending a full tablet report...
I20260808 09:58:21.731246 3195 consensus_queue.cc:260] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:21.731492 2504 raft_consensus.cc:1203] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260808 09:58:21.731524 3195 ts_tablet_manager.cc:1428] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 09:58:21.731652 2761 heartbeater.cc:503] Master 127.24.71.254:41105 was elected leader, sending a full tablet report...
I20260808 09:58:21.732525 2546 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 521226152b5048e4a97fd2c5782a30dd. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } } }
I20260808 09:58:21.732620 2546 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: This master's current role is: LEARNER
I20260808 09:58:21.732697 3201 raft_consensus.cc:348] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:21.732838 3201 raft_consensus.cc:374] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:21.732879 3201 raft_consensus.cc:729] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83edd72a23b543e0aa22dad2db0ca8bd, State: Initialized, Role: FOLLOWER
I20260808 09:58:21.732992 3201 consensus_queue.cc:260] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:21.733368 2957 heartbeater.cc:503] Master 127.24.71.254:41105 was elected leader, sending a full tablet report...
I20260808 09:58:21.733294 3201 ts_tablet_manager.cc:1428] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260808 09:58:21.777231 2960 tablet.cc:2369] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 09:58:21.850212 3204 raft_consensus.cc:482] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:21.850389 3204 raft_consensus.cc:504] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:21.850795 3204 leader_election.cc:288] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 598eca03628e46919b5f8eecd58e7b38 (127.24.71.193:38263), 83edd72a23b543e0aa22dad2db0ca8bd (127.24.71.194:37603)
I20260808 09:58:21.853704 3159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.851022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:38263 (local address 127.24.71.195:41659)
0808 09:58:21.851091 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.851103 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.851153 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.851350 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.851351 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.851353 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:21.851458 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.851460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.852128 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.852129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.852881 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.852883 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.853448 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.853449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.853524 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.853527 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.853593 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.853633 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 09:58:21.853704 3192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.851127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:41659 (local address 127.24.71.193:38263)
0808 09:58:21.851178 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.851180 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.851224 (+ 44us) server_negotiation.cc:407] Connection header received
0808 09:58:21.851260 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.851261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.851269 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.851314 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:21.851547 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.852040 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.852976 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.853364 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.853451 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.853460 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.853601 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.853640 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 09:58:21.853816 3189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.851144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:60625 (local address 127.24.71.194:37603)
0808 09:58:21.851188 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.851190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.851505 (+ 315us) server_negotiation.cc:407] Connection header received
0808 09:58:21.851569 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.851571 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.851579 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.851648 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:21.851797 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.852265 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.853126 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.853475 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.853560 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.853568 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.853715 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.853752 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 09:58:21.853826 3156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.851350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:37603 (local address 127.24.71.195:60625)
0808 09:58:21.851429 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:21.851439 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:21.851506 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:21.851652 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:21.851652 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:21.851654 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:21.851723 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.851724 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.852354 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.852355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.853028 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:21.853030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.853558 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.853559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:21.853637 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.853640 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:21.853709 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 09:58:21.853747 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 09:58:21.854022 2684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e77d372b08c4ac88b362d6f87bbcb47" candidate_uuid: "a549b4bf061f4cc88df1bca82e670696" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598eca03628e46919b5f8eecd58e7b38" is_pre_election: true
I20260808 09:58:21.854197 2684 raft_consensus.cc:2454] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a549b4bf061f4cc88df1bca82e670696 in term 0.
I20260808 09:58:21.854342 2894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e77d372b08c4ac88b362d6f87bbcb47" candidate_uuid: "a549b4bf061f4cc88df1bca82e670696" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" is_pre_election: true
I20260808 09:58:21.854471 2991 leader_election.cc:302] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598eca03628e46919b5f8eecd58e7b38, a549b4bf061f4cc88df1bca82e670696; no voters:
I20260808 09:58:21.854506 2894 raft_consensus.cc:2454] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a549b4bf061f4cc88df1bca82e670696 in term 0.
I20260808 09:58:21.854626 3204 raft_consensus.cc:2781] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:58:21.854689 3204 raft_consensus.cc:482] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:58:21.854719 3204 raft_consensus.cc:3037] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:21.855541 3204 raft_consensus.cc:504] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:21.855722 3204 leader_election.cc:288] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [CANDIDATE]: Term 1 election: Requested vote from peers 598eca03628e46919b5f8eecd58e7b38 (127.24.71.193:38263), 83edd72a23b543e0aa22dad2db0ca8bd (127.24.71.194:37603)
I20260808 09:58:21.855811 2684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e77d372b08c4ac88b362d6f87bbcb47" candidate_uuid: "a549b4bf061f4cc88df1bca82e670696" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598eca03628e46919b5f8eecd58e7b38"
I20260808 09:58:21.855894 2684 raft_consensus.cc:3037] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:21.855933 2894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e77d372b08c4ac88b362d6f87bbcb47" candidate_uuid: "a549b4bf061f4cc88df1bca82e670696" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83edd72a23b543e0aa22dad2db0ca8bd"
I20260808 09:58:21.856031 2894 raft_consensus.cc:3037] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:21.856657 2684 raft_consensus.cc:2454] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a549b4bf061f4cc88df1bca82e670696 in term 1.
I20260808 09:58:21.856848 2991 leader_election.cc:302] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598eca03628e46919b5f8eecd58e7b38, a549b4bf061f4cc88df1bca82e670696; no voters:
I20260808 09:58:21.856920 2894 raft_consensus.cc:2454] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a549b4bf061f4cc88df1bca82e670696 in term 1.
I20260808 09:58:21.856952 3204 raft_consensus.cc:2781] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:21.857101 3204 raft_consensus.cc:686] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [term 1 LEADER]: Becoming Leader. State: Replica: a549b4bf061f4cc88df1bca82e670696, State: Running, Role: LEADER
I20260808 09:58:21.857319 3204 consensus_queue.cc:237] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:21.858443 1343 catalog_manager.cc:5495] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 reported cstate change: term changed from 0 to 1, leader changed from <none> to a549b4bf061f4cc88df1bca82e670696 (127.24.71.195). New cstate: current_term: 1 leader_uuid: "a549b4bf061f4cc88df1bca82e670696" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } health_report { overall_health: UNKNOWN } } }
I20260808 09:58:21.858999 2152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: NON_VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: true } } }
I20260808 09:58:21.859109 2152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:21.860015 2152 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd: attempting to promote NON_VOTER bda4746da1f7494b8cd2c141fab95e92 to VOTER
I20260808 09:58:21.860136 2152 consensus_queue.cc:237] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } }
I20260808 09:58:21.860633 2221 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Refusing update from remote peer 521226152b5048e4a97fd2c5782a30dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260808 09:58:21.860641 2503 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 LEARNER]: Refusing update from remote peer 521226152b5048e4a97fd2c5782a30dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260808 09:58:21.860877 3214 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260808 09:58:21.860984 2152 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260808 09:58:21.861644 3214 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, bda4746da1f7494b8cd2c141fab95e92 (127.24.71.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } } }
I20260808 09:58:21.861816 2503 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, bda4746da1f7494b8cd2c141fab95e92 (127.24.71.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } } }
I20260808 09:58:21.862591 3214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } } }
I20260808 09:58:21.862684 3214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:21.862648 2153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } } }
I20260808 09:58:21.862658 2152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } } }
I20260808 09:58:21.862799 2152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:21.862758 2153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:21.862820 2546 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } } }
I20260808 09:58:21.862905 2546 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 09:58:21.863049 2222 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, bda4746da1f7494b8cd2c141fab95e92 (127.24.71.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } } }
I20260808 09:58:21.864035 3216 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "521226152b5048e4a97fd2c5782a30dd" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } } }
I20260808 09:58:21.864152 3216 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 09:58:21.870592 2764 tablet.cc:2369] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 09:58:21.871049 3190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.868715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51734 (local address 127.24.71.195:36949)
0808 09:58:21.868782 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.868784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.868794 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:21.868851 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.868851 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.868868 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.868922 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:21.869061 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.869518 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.870253 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.870443 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.870540 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.870709 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:21.870821 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:21.870911 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.870951 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.870971 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 09:58:21.872931 2684 raft_consensus.cc:1261] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38 [term 1 FOLLOWER]: Refusing update from remote peer a549b4bf061f4cc88df1bca82e670696: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:21.872938 2894 raft_consensus.cc:1261] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd [term 1 FOLLOWER]: Refusing update from remote peer a549b4bf061f4cc88df1bca82e670696: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:21.873302 3204 consensus_queue.cc:1035] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:21.873437 3211 consensus_queue.cc:1035] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:21.876467 3222 mvcc.cc:205] Tried to move back new op lower bound from 7316205985268793344 to 7316205985208270848. Current Snapshot: MvccSnapshot[applied={T|T < 7316205985268793344}]
I20260808 09:58:21.877460 3221 mvcc.cc:205] Tried to move back new op lower bound from 7316205985268793344 to 7316205985208270848. Current Snapshot: MvccSnapshot[applied={T|T < 7316205985268793344 or (T in {7316205985268793344})}]
I20260808 09:58:21.879698 1339 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:21.879801 1339 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:21.881168 1339 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 521226152b5048e4a97fd2c5782a30dd: Sending DeleteTablet for 3 replicas of tablet 8e77d372b08c4ac88b362d6f87bbcb47
I20260808 09:58:21.881510 3057 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e77d372b08c4ac88b362d6f87bbcb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:21 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:51720
I20260808 09:58:21.881771 2658 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e77d372b08c4ac88b362d6f87bbcb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:21 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:46096
I20260808 09:58:21.881973 2864 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e77d372b08c4ac88b362d6f87bbcb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:21 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:59448
I20260808 09:58:21.882076 3233 tablet_replica.cc:330] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38: stopping tablet replica
I20260808 09:58:21.882135 3232 tablet_replica.cc:330] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696: stopping tablet replica
I20260808 09:58:21.882179 3233 raft_consensus.cc:2229] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:21.882218 3232 raft_consensus.cc:2229] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [term 1 LEADER]: Raft consensus shutting down.
I20260808 09:58:21.882290 3233 raft_consensus.cc:2258] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:21.882324 3232 raft_consensus.cc:2258] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:21.882738 3232 ts_tablet_manager.cc:1905] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:21.883219 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 1298
I20260808 09:58:21.883234 3233 ts_tablet_manager.cc:1905] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:21.884970 3233 ts_tablet_manager.cc:1918] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:21.885044 3232 ts_tablet_manager.cc:1918] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:21.885141 3232 log.cc:1196] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/8e77d372b08c4ac88b362d6f87bbcb47
I20260808 09:58:21.885156 3233 log.cc:1196] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-0/wal/wals/8e77d372b08c4ac88b362d6f87bbcb47
I20260808 09:58:21.885509 3232 ts_tablet_manager.cc:1939] T 8e77d372b08c4ac88b362d6f87bbcb47 P a549b4bf061f4cc88df1bca82e670696: Deleting consensus metadata
I20260808 09:58:21.885615 3233 ts_tablet_manager.cc:1939] T 8e77d372b08c4ac88b362d6f87bbcb47 P 598eca03628e46919b5f8eecd58e7b38: Deleting consensus metadata
I20260808 09:58:21.891748 3236 tablet_replica.cc:330] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd: stopping tablet replica
I20260808 09:58:21.891913 3236 raft_consensus.cc:2229] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:21.892050 3236 raft_consensus.cc:2258] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:21.892923 3236 ts_tablet_manager.cc:1905] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:21.894675 3236 ts_tablet_manager.cc:1918] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:21.894745 3236 log.cc:1196] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/8e77d372b08c4ac88b362d6f87bbcb47
I20260808 09:58:21.895028 3236 ts_tablet_manager.cc:1939] T 8e77d372b08c4ac88b362d6f87bbcb47 P 83edd72a23b543e0aa22dad2db0ca8bd: Deleting consensus metadata
W20260808 09:58:21.897934 2795 connection.cc:535] server connection from 127.0.0.1:59448 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 09:58:21.898197 2991 connection.cc:535] server connection from 127.0.0.1:51720 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 09:58:21.898206 2588 connection.cc:535] server connection from 127.0.0.1:46096 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 09:58:21.900621 3173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.882563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54846 (local address 127.24.71.252:34959)
0808 09:58:21.882608 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.882610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.891595 (+ 8985us) server_negotiation.cc:407] Connection header received
0808 09:58:21.891670 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.891671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.891686 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.891743 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.892542 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.893354 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.894676 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.895016 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.895060 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.897101 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.897103 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.897103 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.897112 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.899143 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.899596 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.899597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.899597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.899664 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.899919 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.899920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.899920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.900041 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.900155 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.900256 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.900344 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 09:58:21.908821 3176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.900712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41706 (local address 127.24.71.253:39277)
0808 09:58:21.900815 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.900835 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.900843 (+ 8us) server_negotiation.cc:407] Connection header received
0808 09:58:21.900865 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.900866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.900879 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.900933 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.902159 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.902891 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.903770 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.904079 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.904141 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.905526 (+ 1385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.905527 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.905528 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.905535 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.907234 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.907714 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.907715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.907715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.907785 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.907960 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.907961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.907962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.908101 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.908194 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.908431 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.908528 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 09:58:21.908895 2765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:21.900622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54850 (local address 127.24.71.252:34959)
0808 09:58:21.900661 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:21.900663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:21.901256 (+ 593us) server_negotiation.cc:407] Connection header received
0808 09:58:21.901329 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:21.901330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:21.901341 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:21.901394 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:21.902019 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.902784 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.903896 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:21.904175 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:21.904251 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:21.905877 (+ 1626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:21.905879 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:21.905879 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:21.905886 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:21.907629 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.908024 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.908025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.908026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.908073 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:21.908286 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:21.908287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:21.908287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:21.908420 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:21.908507 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:21.908698 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 09:58:21.908791 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 09:58:22.877800 3254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:22.877535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.193:43427)
0808 09:58:22.877653 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:22.877743 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":70,"threads_started":1}
I20260808 09:58:22.877996 3255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:22.877591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.195:56025)
0808 09:58:22.877853 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:22.877938 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":83,"threads_started":1}
I20260808 09:58:22.878134 3250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:22.877410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.194:59317)
0808 09:58:22.878008 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:22.878085 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":108,"threads_started":1}
W20260808 09:58:22.878243 2761 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:41105 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
W20260808 09:58:22.878328 2957 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:41105 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
W20260808 09:58:22.878393 3151 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:41105 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
I20260808 09:58:23.383154 3257 raft_consensus.cc:482] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 521226152b5048e4a97fd2c5782a30dd)
I20260808 09:58:23.383296 3257 raft_consensus.cc:504] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } }
I20260808 09:58:23.383469 3258 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 521226152b5048e4a97fd2c5782a30dd)
I20260808 09:58:23.383558 3258 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } }
I20260808 09:58:23.383646 3257 leader_election.cc:288] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105), bdfd5bbc5cad4546a5bbeccce71a8809 (127.24.71.253:39277)
I20260808 09:58:23.383726 3258 leader_election.cc:288] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105), bda4746da1f7494b8cd2c141fab95e92 (127.24.71.252:34959)
I20260808 09:58:23.384087 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.383841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50552)
0808 09:58:23.383976 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:23.384037 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":89,"threads_started":1}
I20260808 09:58:23.384248 3262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.383826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50550)
0808 09:58:23.384158 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:23.384206 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":55,"threads_started":1}
W20260808 09:58:23.384392 2461 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
W20260808 09:58:23.384399 2184 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
I20260808 09:58:23.384826 3263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.384727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50566)
0808 09:58:23.384764 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:23.384799 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 09:58:23.384893 2184 leader_election.cc:334] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105): Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
I20260808 09:58:23.385079 3262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.384936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50572)
0808 09:58:23.385025 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:23.385051 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260808 09:58:23.385187 2461 leader_election.cc:334] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105): Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
I20260808 09:58:23.387497 3259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.384012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:39277 (local address 127.0.0.1:41722)
0808 09:58:23.384400 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:23.384411 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:23.384564 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:23.384763 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:23.384765 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:23.384767 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:23.384816 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:23.384818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:23.385638 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:23.385638 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:23.386385 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:23.386387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:23.387187 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:23.387188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:23.387256 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:23.387260 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:58:23.387355 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 09:58:23.387430 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":40,"threads_started":1}
I20260808 09:58:23.387508 3264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.384060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41722 (local address 127.24.71.253:39277)
0808 09:58:23.384288 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:23.384291 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:23.384532 (+ 241us) server_negotiation.cc:407] Connection header received
0808 09:58:23.384647 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:23.384648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:23.384657 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:23.384745 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:23.384906 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:23.385551 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:23.386484 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:23.387102 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:23.387185 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:23.387198 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:23.387364 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 09:58:23.387426 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":43,"threads_started":1}
I20260808 09:58:23.387914 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.384040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:34959 (local address 127.0.0.1:54860)
0808 09:58:23.384150 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:23.384161 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:23.384223 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:23.384515 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:23.384517 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:23.384519 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:23.384587 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:23.384590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:23.385549 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:23.385550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:23.386911 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:23.386914 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:23.387693 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:23.387695 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:23.387755 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:23.387759 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:58:23.387805 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 09:58:23.387843 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":39,"threads_started":1}
I20260808 09:58:23.388028 2222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bda4746da1f7494b8cd2c141fab95e92" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" is_pre_election: true
I20260808 09:58:23.388149 2222 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda4746da1f7494b8cd2c141fab95e92 in term 1.
I20260808 09:58:23.387936 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.384232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54860 (local address 127.24.71.252:34959)
0808 09:58:23.384341 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:23.384343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:23.384351 (+ 8us) server_negotiation.cc:407] Connection header received
0808 09:58:23.384391 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:23.384392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:23.384403 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:23.384658 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:23.384700 (+ 42us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:23.385461 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:23.387006 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:23.387601 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:23.387673 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:23.387684 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:23.387817 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 09:58:23.387847 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":68,"threads_started":1}
I20260808 09:58:23.388392 2461 leader_election.cc:302] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda4746da1f7494b8cd2c141fab95e92, bdfd5bbc5cad4546a5bbeccce71a8809; no voters: 521226152b5048e4a97fd2c5782a30dd
I20260808 09:58:23.388453 2503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bda4746da1f7494b8cd2c141fab95e92" is_pre_election: true
I20260808 09:58:23.388517 3257 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 09:58:23.388552 2503 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfd5bbc5cad4546a5bbeccce71a8809 in term 1.
I20260808 09:58:23.388581 3257 raft_consensus.cc:482] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 521226152b5048e4a97fd2c5782a30dd)
I20260808 09:58:23.388607 3257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 1 FOLLOWER]: Advancing to term 2
I20260808 09:58:23.388703 2184 leader_election.cc:302] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda4746da1f7494b8cd2c141fab95e92, bdfd5bbc5cad4546a5bbeccce71a8809; no voters: 521226152b5048e4a97fd2c5782a30dd
I20260808 09:58:23.388818 3258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 09:58:23.388856 3258 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 521226152b5048e4a97fd2c5782a30dd)
I20260808 09:58:23.388886 3258 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 1 FOLLOWER]: Advancing to term 2
I20260808 09:58:23.389586 3257 raft_consensus.cc:504] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } }
I20260808 09:58:23.389786 3258 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } }
I20260808 09:58:23.389918 3258 leader_election.cc:288] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [CANDIDATE]: Term 2 election: Requested vote from peers 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105), bda4746da1f7494b8cd2c141fab95e92 (127.24.71.252:34959)
I20260808 09:58:23.389967 3259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.389832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50582)
0808 09:58:23.389885 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:23.389936 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260808 09:58:23.390045 2222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bda4746da1f7494b8cd2c141fab95e92" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809"
I20260808 09:58:23.390134 2222 raft_consensus.cc:2379] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bda4746da1f7494b8cd2c141fab95e92 in current term 2: Already voted for candidate bdfd5bbc5cad4546a5bbeccce71a8809 in this term.
I20260808 09:58:23.390184 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.390050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50588)
0808 09:58:23.390086 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:23.390128 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260808 09:58:23.390213 2503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bda4746da1f7494b8cd2c141fab95e92"
I20260808 09:58:23.390317 2503 raft_consensus.cc:2379] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bdfd5bbc5cad4546a5bbeccce71a8809 in current term 2: Already voted for candidate bda4746da1f7494b8cd2c141fab95e92 in this term.
I20260808 09:58:23.390362 3257 leader_election.cc:288] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [CANDIDATE]: Term 2 election: Requested vote from peers 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105), bdfd5bbc5cad4546a5bbeccce71a8809 (127.24.71.253:39277)
I20260808 09:58:23.390527 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.390404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50596)
0808 09:58:23.390474 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:23.390500 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 09:58:23.390578 2184 leader_election.cc:334] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105): Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
I20260808 09:58:23.390605 2184 leader_election.cc:302] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdfd5bbc5cad4546a5bbeccce71a8809; no voters: 521226152b5048e4a97fd2c5782a30dd, bda4746da1f7494b8cd2c141fab95e92
I20260808 09:58:23.390619 3259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.390536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:50602)
0808 09:58:23.390568 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:23.390592 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260808 09:58:23.390681 2461 leader_election.cc:334] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105): Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
I20260808 09:58:23.390699 3258 raft_consensus.cc:2726] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 09:58:23.390717 2461 leader_election.cc:302] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda4746da1f7494b8cd2c141fab95e92; no voters: 521226152b5048e4a97fd2c5782a30dd, bdfd5bbc5cad4546a5bbeccce71a8809
I20260808 09:58:23.390875 3257 raft_consensus.cc:2726] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 09:58:23.878918 3270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.878645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.194:54861)
0808 09:58:23.878812 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:23.878860 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":69,"threads_started":1}
I20260808 09:58:23.879168 3271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.878653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.193:53675)
0808 09:58:23.879090 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:23.879129 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":67,"threads_started":1}
I20260808 09:58:23.879422 3272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:23.878850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.195:35289)
0808 09:58:23.879307 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:23.879351 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":68,"threads_started":1}
I20260808 09:58:24.879845 3274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:24.879514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.194:38045)
0808 09:58:24.879731 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:24.879781 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":71,"threads_started":1}
I20260808 09:58:24.880014 3276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:24.879820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.193:59809)
0808 09:58:24.879934 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:24.879972 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":54,"threads_started":1}
I20260808 09:58:24.880125 3275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:24.879805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.195:59711)
0808 09:58:24.880048 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:24.880081 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":55,"threads_started":1}
I20260808 09:58:25.177151 3277 raft_consensus.cc:482] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:25.177251 3277 raft_consensus.cc:504] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } }
I20260808 09:58:25.177429 3277 leader_election.cc:288] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105), bdfd5bbc5cad4546a5bbeccce71a8809 (127.24.71.253:39277)
I20260808 09:58:25.177878 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.177632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:48674)
0808 09:58:25.177775 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.177819 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
I20260808 09:58:25.177949 2222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bda4746da1f7494b8cd2c141fab95e92" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" is_pre_election: true
I20260808 09:58:25.178089 2222 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda4746da1f7494b8cd2c141fab95e92 in term 2.
I20260808 09:58:25.178360 2461 leader_election.cc:302] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda4746da1f7494b8cd2c141fab95e92, bdfd5bbc5cad4546a5bbeccce71a8809; no voters:
I20260808 09:58:25.178400 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.178313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:48686)
0808 09:58:25.178347 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.178377 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260808 09:58:25.178455 2461 leader_election.cc:334] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105): Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
I20260808 09:58:25.178486 3277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 09:58:25.178531 3277 raft_consensus.cc:482] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:58:25.178551 3277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 2 FOLLOWER]: Advancing to term 3
I20260808 09:58:25.179332 3277 raft_consensus.cc:504] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } }
I20260808 09:58:25.179525 3277 leader_election.cc:288] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [CANDIDATE]: Term 3 election: Requested vote from peers 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105), bdfd5bbc5cad4546a5bbeccce71a8809 (127.24.71.253:39277)
I20260808 09:58:25.179716 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.179643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:48688)
0808 09:58:25.179672 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.179699 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260808 09:58:25.179818 2222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bda4746da1f7494b8cd2c141fab95e92" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809"
I20260808 09:58:25.179930 2222 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 2 FOLLOWER]: Advancing to term 3
I20260808 09:58:25.180548 2222 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda4746da1f7494b8cd2c141fab95e92 in term 3.
I20260808 09:58:25.180718 2461 leader_election.cc:302] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda4746da1f7494b8cd2c141fab95e92, bdfd5bbc5cad4546a5bbeccce71a8809; no voters:
I20260808 09:58:25.180835 3277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 09:58:25.180949 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.180841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:48696)
0808 09:58:25.180894 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.180924 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 09:58:25.180963 3277 raft_consensus.cc:686] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [term 3 LEADER]: Becoming Leader. State: Replica: bda4746da1f7494b8cd2c141fab95e92, State: Running, Role: LEADER
W20260808 09:58:25.181027 2461 leader_election.cc:334] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105): Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
I20260808 09:58:25.181077 3277 consensus_queue.cc:237] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } }
I20260808 09:58:25.181443 3282 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bda4746da1f7494b8cd2c141fab95e92. Latest consensus state: current_term: 3 leader_uuid: "bda4746da1f7494b8cd2c141fab95e92" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } } }
I20260808 09:58:25.181545 3282 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:25.181746 3284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:25.182286 3284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:25.182408 3284 catalog_manager.cc:1259] Loaded cluster ID: 1f5eee97dbf44a56a4835990db82703a
I20260808 09:58:25.182442 3284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:25.182745 3284 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:25.182839 3284 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: Loaded TSK: 0
I20260808 09:58:25.182998 3284 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 09:58:25.243589 2485 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54850:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:58:25.245182 2485 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:58:25.246237 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.246088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:48722)
0808 09:58:25.246162 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.246199 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 09:58:25.246331 2222 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [term 3 FOLLOWER]: Refusing update from remote peer bda4746da1f7494b8cd2c141fab95e92: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260808 09:58:25.246574 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.246483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.0.0.1:48724)
0808 09:58:25.246520 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.246555 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260808 09:58:25.246591 3277 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260808 09:58:25.246712 2461 consensus_peers.cc:487] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 -> Peer 521226152b5048e4a97fd2c5782a30dd (127.24.71.254:41105): Couldn't send request to peer 521226152b5048e4a97fd2c5782a30dd. Status: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 09:58:25.247251 3286 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bda4746da1f7494b8cd2c141fab95e92. Latest consensus state: current_term: 3 leader_uuid: "bda4746da1f7494b8cd2c141fab95e92" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } } }
I20260808 09:58:25.247370 3286 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 09:58:25.247750 3285 mvcc.cc:205] Tried to move back new op lower bound from 7316205999086452736 to 7316205998822248448. Current Snapshot: MvccSnapshot[applied={T|T < 7316205999086452736}]
I20260808 09:58:25.247869 3277 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "bda4746da1f7494b8cd2c141fab95e92" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } } }
I20260808 09:58:25.248073 3277 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:25.248297 3287 mvcc.cc:205] Tried to move back new op lower bound from 7316205999086452736 to 7316205998822248448. Current Snapshot: MvccSnapshot[applied={T|T < 7316205999086452736}]
I20260808 09:58:25.248675 3286 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "bda4746da1f7494b8cd2c141fab95e92" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "521226152b5048e4a97fd2c5782a30dd" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41105 } } peers { permanent_uuid: "bdfd5bbc5cad4546a5bbeccce71a8809" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 39277 } attrs { promote: false } } peers { permanent_uuid: "bda4746da1f7494b8cd2c141fab95e92" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 34959 } attrs { promote: false } } }
I20260808 09:58:25.248775 3286 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfd5bbc5cad4546a5bbeccce71a8809 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 09:58:25.253252 3300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.249924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44236 (local address 127.24.71.194:37603)
0808 09:58:25.250081 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:25.250083 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:25.250119 (+ 36us) server_negotiation.cc:407] Connection header received
0808 09:58:25.250201 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:25.250202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:25.250211 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:25.250281 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:25.250451 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.251223 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.252396 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.252897 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.252985 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:25.252998 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:25.253139 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 09:58:25.253179 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":53,"threads_started":1}
I20260808 09:58:25.253294 3298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.249752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:37603 (local address 127.0.0.1:44236)
0808 09:58:25.250071 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.250079 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:25.250130 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:25.250299 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:25.250300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:25.250303 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:25.250356 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:25.250358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.251326 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.251327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:25.252315 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:25.252317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.252984 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.252985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:25.253057 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:25.253063 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 09:58:25.253133 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 09:58:25.253175 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":65,"threads_started":1}
I20260808 09:58:25.253377 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.249688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:38263 (local address 127.0.0.1:56042)
0808 09:58:25.249731 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.249743 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:25.249793 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:25.250386 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:25.250387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:25.250388 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:25.250418 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:25.250419 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.251310 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.251311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:25.252454 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:25.252456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.253194 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.253195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:25.253247 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:25.253249 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 09:58:25.253279 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 09:58:25.253320 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":35}
I20260808 09:58:25.253468 3304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.249968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43014 (local address 127.24.71.195:36949)
0808 09:58:25.250071 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:25.250072 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:25.250082 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:25.250110 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:25.250111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:25.250122 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:25.250198 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:25.250498 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.250977 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.252303 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.252941 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.253010 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:25.253021 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:25.253331 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 09:58:25.253384 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":55,"threads_started":1}
I20260808 09:58:25.253470 3296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.249729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:36949 (local address 127.0.0.1:43014)
0808 09:58:25.249930 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.249940 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:25.249991 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:25.250255 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:25.250257 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:25.250259 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:25.250325 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:25.250327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.251060 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.251061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:25.252206 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:25.252209 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.253058 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.253059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:25.253124 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:25.253129 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 09:58:25.253178 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 09:58:25.253220 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":91,"threads_started":1}
I20260808 09:58:25.253679 3057 tablet_service.cc:1467] Processing CreateTablet for tablet f5815b9b4ddf425cb6883180d8942741 (DEFAULT_TABLE table=test-table [id=f5a4e067f8f64786b46ce49304668983]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:25.253849 3057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5815b9b4ddf425cb6883180d8942741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:25.253856 2864 tablet_service.cc:1467] Processing CreateTablet for tablet f5815b9b4ddf425cb6883180d8942741 (DEFAULT_TABLE table=test-table [id=f5a4e067f8f64786b46ce49304668983]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:25.253960 2864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5815b9b4ddf425cb6883180d8942741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:25.254194 3299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.249824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56042 (local address 127.24.71.193:38263)
0808 09:58:25.250231 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:25.250233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:25.250241 (+ 8us) server_negotiation.cc:407] Connection header received
0808 09:58:25.250296 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:25.250296 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:25.250307 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:25.250385 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:25.250475 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.251224 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.252536 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.253101 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.254004 (+ 903us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:25.254023 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:25.254042 (+ 19us) server_negotiation.cc:299] Negotiation successful
0808 09:58:25.254111 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":92,"threads_started":1}
I20260808 09:58:25.254376 2658 tablet_service.cc:1467] Processing CreateTablet for tablet f5815b9b4ddf425cb6883180d8942741 (DEFAULT_TABLE table=test-table [id=f5a4e067f8f64786b46ce49304668983]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:25.254504 2658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5815b9b4ddf425cb6883180d8942741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:25.255509 3306 tablet_bootstrap.cc:492] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd: Bootstrap starting.
I20260808 09:58:25.255781 3309 tablet_bootstrap.cc:492] T f5815b9b4ddf425cb6883180d8942741 P 598eca03628e46919b5f8eecd58e7b38: Bootstrap starting.
I20260808 09:58:25.255978 3306 tablet_bootstrap.cc:654] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:25.256222 3309 tablet_bootstrap.cc:654] T f5815b9b4ddf425cb6883180d8942741 P 598eca03628e46919b5f8eecd58e7b38: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:25.256337 3308 tablet_bootstrap.cc:492] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696: Bootstrap starting.
I20260808 09:58:25.256649 3306 tablet_bootstrap.cc:492] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd: No bootstrap required, opened a new log
I20260808 09:58:25.256696 3306 ts_tablet_manager.cc:1397] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:25.256719 3308 tablet_bootstrap.cc:654] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:25.256853 3306 raft_consensus.cc:348] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:25.256944 3306 raft_consensus.cc:374] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:25.256981 3306 raft_consensus.cc:729] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83edd72a23b543e0aa22dad2db0ca8bd, State: Initialized, Role: FOLLOWER
I20260808 09:58:25.257038 3306 consensus_queue.cc:260] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:25.257232 3306 ts_tablet_manager.cc:1428] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:25.257550 3274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.257449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.194:38383)
0808 09:58:25.257483 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.257518 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260808 09:58:25.257560 3308 tablet_bootstrap.cc:492] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696: No bootstrap required, opened a new log
I20260808 09:58:25.257606 3308 ts_tablet_manager.cc:1397] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:25.257735 3308 raft_consensus.cc:348] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:25.257809 3308 raft_consensus.cc:374] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:25.257834 3308 raft_consensus.cc:729] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a549b4bf061f4cc88df1bca82e670696, State: Initialized, Role: FOLLOWER
I20260808 09:58:25.257922 2958 heartbeater.cc:503] Master 127.24.71.252:34959 was elected leader, sending a full tablet report...
I20260808 09:58:25.257889 3308 consensus_queue.cc:260] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:25.258059 3274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.257802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.194:56799)
0808 09:58:25.258005 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.258033 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187}
I20260808 09:58:25.258101 3308 ts_tablet_manager.cc:1428] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:25.258355 3275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.258264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.195:57129)
0808 09:58:25.258301 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.258327 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260808 09:58:25.258405 3309 tablet_bootstrap.cc:492] T f5815b9b4ddf425cb6883180d8942741 P 598eca03628e46919b5f8eecd58e7b38: No bootstrap required, opened a new log
I20260808 09:58:25.258443 3309 ts_tablet_manager.cc:1397] T f5815b9b4ddf425cb6883180d8942741 P 598eca03628e46919b5f8eecd58e7b38: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 09:58:25.258594 3309 raft_consensus.cc:348] T f5815b9b4ddf425cb6883180d8942741 P 598eca03628e46919b5f8eecd58e7b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:25.258659 3309 raft_consensus.cc:374] T f5815b9b4ddf425cb6883180d8942741 P 598eca03628e46919b5f8eecd58e7b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:25.258678 3309 raft_consensus.cc:729] T f5815b9b4ddf425cb6883180d8942741 P 598eca03628e46919b5f8eecd58e7b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598eca03628e46919b5f8eecd58e7b38, State: Initialized, Role: FOLLOWER
I20260808 09:58:25.258744 3309 consensus_queue.cc:260] T f5815b9b4ddf425cb6883180d8942741 P 598eca03628e46919b5f8eecd58e7b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:25.258962 3309 ts_tablet_manager.cc:1428] T f5815b9b4ddf425cb6883180d8942741 P 598eca03628e46919b5f8eecd58e7b38: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:25.259186 3152 heartbeater.cc:503] Master 127.24.71.252:34959 was elected leader, sending a full tablet report...
I20260808 09:58:25.259191 3275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.259067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.195:49177)
0808 09:58:25.259128 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.259158 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 09:58:25.259371 3276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.259271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.193:38467)
0808 09:58:25.259314 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.259344 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 09:58:25.415729 3313 raft_consensus.cc:482] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:25.415846 3313 raft_consensus.cc:504] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:25.416158 3313 leader_election.cc:288] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 598eca03628e46919b5f8eecd58e7b38 (127.24.71.193:38263), a549b4bf061f4cc88df1bca82e670696 (127.24.71.195:36949)
I20260808 09:58:25.419435 3299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.416501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:54097 (local address 127.24.71.193:38263)
0808 09:58:25.416551 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:25.416553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:25.416568 (+ 15us) server_negotiation.cc:407] Connection header received
0808 09:58:25.416642 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:25.416643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:25.416653 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:25.416738 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:25.416996 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.417708 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.418659 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.419035 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.419137 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:25.419148 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:25.419293 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 09:58:25.419334 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 09:58:25.419473 3304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.416502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:49343 (local address 127.24.71.195:36949)
0808 09:58:25.416565 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:25.416567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:25.416739 (+ 172us) server_negotiation.cc:407] Connection header received
0808 09:58:25.416831 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:25.416832 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:25.416843 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:25.416907 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:25.417098 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.417650 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.418663 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.419037 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.419125 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:25.419135 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:25.419334 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 09:58:25.419376 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 09:58:25.419477 3274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.416409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:38263 (local address 127.24.71.194:54097)
0808 09:58:25.416488 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.416502 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:25.416575 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:25.416812 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:25.416814 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:25.416816 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:25.416913 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:25.416915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.417807 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.417808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:25.418559 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:25.418561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.419133 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.419134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:25.419213 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:25.419217 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:58:25.419261 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 09:58:25.419320 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 09:58:25.419490 3317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.416409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:36949 (local address 127.24.71.194:49343)
0808 09:58:25.416646 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.416659 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:25.416728 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:25.416921 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:25.416921 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:25.416923 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:25.417006 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:25.417008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.417734 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.417735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:25.418558 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:25.418561 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.419159 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.419161 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:25.419231 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:25.419234 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:25.419307 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 09:58:25.419343 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":24,"thread_start_us":134,"threads_started":1}
I20260808 09:58:25.419776 2684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5815b9b4ddf425cb6883180d8942741" candidate_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598eca03628e46919b5f8eecd58e7b38" is_pre_election: true
I20260808 09:58:25.419888 2684 raft_consensus.cc:2454] T f5815b9b4ddf425cb6883180d8942741 P 598eca03628e46919b5f8eecd58e7b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83edd72a23b543e0aa22dad2db0ca8bd in term 0.
I20260808 09:58:25.420017 3089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5815b9b4ddf425cb6883180d8942741" candidate_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a549b4bf061f4cc88df1bca82e670696" is_pre_election: true
I20260808 09:58:25.420068 2793 leader_election.cc:302] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598eca03628e46919b5f8eecd58e7b38, 83edd72a23b543e0aa22dad2db0ca8bd; no voters:
I20260808 09:58:25.420138 3089 raft_consensus.cc:2454] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83edd72a23b543e0aa22dad2db0ca8bd in term 0.
I20260808 09:58:25.420207 3313 raft_consensus.cc:2781] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:58:25.420252 3313 raft_consensus.cc:482] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:58:25.420284 3313 raft_consensus.cc:3037] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:25.421000 3313 raft_consensus.cc:504] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:25.421160 3313 leader_election.cc:288] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [CANDIDATE]: Term 1 election: Requested vote from peers 598eca03628e46919b5f8eecd58e7b38 (127.24.71.193:38263), a549b4bf061f4cc88df1bca82e670696 (127.24.71.195:36949)
I20260808 09:58:25.421306 2684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5815b9b4ddf425cb6883180d8942741" candidate_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598eca03628e46919b5f8eecd58e7b38"
I20260808 09:58:25.421381 2684 raft_consensus.cc:3037] T f5815b9b4ddf425cb6883180d8942741 P 598eca03628e46919b5f8eecd58e7b38 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:25.421361 3089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5815b9b4ddf425cb6883180d8942741" candidate_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a549b4bf061f4cc88df1bca82e670696"
I20260808 09:58:25.421464 3089 raft_consensus.cc:3037] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:25.422021 2684 raft_consensus.cc:2454] T f5815b9b4ddf425cb6883180d8942741 P 598eca03628e46919b5f8eecd58e7b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83edd72a23b543e0aa22dad2db0ca8bd in term 1.
I20260808 09:58:25.422206 2793 leader_election.cc:302] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598eca03628e46919b5f8eecd58e7b38, 83edd72a23b543e0aa22dad2db0ca8bd; no voters:
I20260808 09:58:25.422310 3313 raft_consensus.cc:2781] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:25.422348 3089 raft_consensus.cc:2454] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83edd72a23b543e0aa22dad2db0ca8bd in term 1.
I20260808 09:58:25.422506 3313 raft_consensus.cc:686] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [term 1 LEADER]: Becoming Leader. State: Replica: 83edd72a23b543e0aa22dad2db0ca8bd, State: Running, Role: LEADER
I20260808 09:58:25.422587 3313 consensus_queue.cc:237] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } } peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } }
I20260808 09:58:25.422857 3317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.422750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.194:50387)
0808 09:58:25.422795 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.422825 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 09:58:25.423465 2485 catalog_manager.cc:5495] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 83edd72a23b543e0aa22dad2db0ca8bd (127.24.71.194). New cstate: current_term: 1 leader_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83edd72a23b543e0aa22dad2db0ca8bd" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 37603 } health_report { overall_health: HEALTHY } } }
I20260808 09:58:25.434365 3300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.431913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44250 (local address 127.24.71.194:37603)
0808 09:58:25.431966 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:25.431968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:25.431978 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:25.432026 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:25.432027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:25.432045 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:25.432113 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:25.432290 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.432836 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.433580 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:25.433865 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:25.433927 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:25.434077 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:25.434184 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:25.434239 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:25.434289 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 09:58:25.434306 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 09:58:25.435674 2684 raft_consensus.cc:1261] T f5815b9b4ddf425cb6883180d8942741 P 598eca03628e46919b5f8eecd58e7b38 [term 1 FOLLOWER]: Refusing update from remote peer 83edd72a23b543e0aa22dad2db0ca8bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:25.435770 3089 raft_consensus.cc:1261] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696 [term 1 FOLLOWER]: Refusing update from remote peer 83edd72a23b543e0aa22dad2db0ca8bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:25.436050 3313 consensus_queue.cc:1035] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "598eca03628e46919b5f8eecd58e7b38" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:25.436216 3318 consensus_queue.cc:1035] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a549b4bf061f4cc88df1bca82e670696" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:25.436753 2762 heartbeater.cc:503] Master 127.24.71.252:34959 was elected leader, sending a full tablet report...
I20260808 09:58:25.436901 3276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.436793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.193:47513)
0808 09:58:25.436841 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.436870 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 09:58:25.437564 3275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.437400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.195:55001)
0808 09:58:25.437504 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.437532 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 09:58:25.438862 3275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.438755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.195:46091)
0808 09:58:25.438795 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.438832 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260808 09:58:25.438958 3317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.438823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.194:55151)
0808 09:58:25.438864 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.438917 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 09:58:25.439443 3317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.439304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.194:58819)
0808 09:58:25.439363 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.439415 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 09:58:25.440531 3276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.440421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41105 (local address 127.24.71.193:41881)
0808 09:58:25.440472 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.440498 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:41105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 09:58:25.441361 2485 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:25.441458 2485 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:25.442864 2485 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bda4746da1f7494b8cd2c141fab95e92: Sending DeleteTablet for 3 replicas of tablet f5815b9b4ddf425cb6883180d8942741
I20260808 09:58:25.443221 2864 tablet_service.cc:1514] Processing DeleteTablet for tablet f5815b9b4ddf425cb6883180d8942741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:25 UTC) from {username='oryx', principal='oryx/127.24.71.252@KRBTEST.COM'} at 127.0.0.1:44236
I20260808 09:58:25.443264 2658 tablet_service.cc:1514] Processing DeleteTablet for tablet f5815b9b4ddf425cb6883180d8942741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:25 UTC) from {username='oryx', principal='oryx/127.24.71.252@KRBTEST.COM'} at 127.0.0.1:56042
I20260808 09:58:25.443452 3057 tablet_service.cc:1514] Processing DeleteTablet for tablet f5815b9b4ddf425cb6883180d8942741 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:25 UTC) from {username='oryx', principal='oryx/127.24.71.252@KRBTEST.COM'} at 127.0.0.1:43014
I20260808 09:58:25.443620 3334 tablet_replica.cc:330] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd: stopping tablet replica
I20260808 09:58:25.443626 3336 tablet_replica.cc:330] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696: stopping tablet replica
I20260808 09:58:25.443682 3334 raft_consensus.cc:2229] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [term 1 LEADER]: Raft consensus shutting down.
I20260808 09:58:25.443686 3336 raft_consensus.cc:2229] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:25.443732 3336 raft_consensus.cc:2258] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:25.443778 3334 raft_consensus.cc:2258] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:25.444084 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 2415
I20260808 09:58:25.444576 3336 ts_tablet_manager.cc:1905] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:25.445101 3334 ts_tablet_manager.cc:1905] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:25.446835 3336 ts_tablet_manager.cc:1918] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:25.446904 3334 ts_tablet_manager.cc:1918] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:25.446982 3336 log.cc:1196] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/f5815b9b4ddf425cb6883180d8942741
I20260808 09:58:25.447084 3334 log.cc:1196] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/f5815b9b4ddf425cb6883180d8942741
I20260808 09:58:25.447292 3336 ts_tablet_manager.cc:1939] T f5815b9b4ddf425cb6883180d8942741 P a549b4bf061f4cc88df1bca82e670696: Deleting consensus metadata
I20260808 09:58:25.447518 3334 ts_tablet_manager.cc:1939] T f5815b9b4ddf425cb6883180d8942741 P 83edd72a23b543e0aa22dad2db0ca8bd: Deleting consensus metadata
I20260808 09:58:25.448046 2460 catalog_manager.cc:4841] TS 83edd72a23b543e0aa22dad2db0ca8bd (127.24.71.194:37603): tablet f5815b9b4ddf425cb6883180d8942741 (table test-table [id=f5a4e067f8f64786b46ce49304668983]) successfully deleted
I20260808 09:58:25.448289 2464 catalog_manager.cc:4841] TS a549b4bf061f4cc88df1bca82e670696 (127.24.71.195:36949): tablet f5815b9b4ddf425cb6883180d8942741 (table test-table [id=f5a4e067f8f64786b46ce49304668983]) successfully deleted
I20260808 09:58:25.459491 3296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:25.459253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:38263 (local address 127.0.0.1:56048)
0808 09:58:25.459349 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:25.459383 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:38263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 09:58:25.459564 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 2769
W20260808 09:58:25.459688 2461 catalog_manager.cc:4584] TS 598eca03628e46919b5f8eecd58e7b38 (127.24.71.193:38263): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f5815b9b4ddf425cb6883180d8942741: Network error: Client connection negotiation failed: client connection to 127.24.71.193:38263: connect: Connection refused (error 111)
I20260808 09:58:25.467974 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 2965
I20260808 09:58:25.483999 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 2017
I20260808 09:58:25.496709 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 2286
2026-08-08T09:58:25Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6886 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:58:25 dist-test-slave-gw5c krb5kdc[3340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:58:25 dist-test-slave-gw5c krb5kdc[3340](info): set up 2 sockets
Aug 08 09:58:25 dist-test-slave-gw5c krb5kdc[3340](info): commencing operation
krb5kdc: starting...
W20260808 09:58:26.737362 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:58:26 dist-test-slave-gw5c krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:58:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:26Z Disabled control of system clock
WARNING: no policy specified for oryx/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.254.keytab.
Entry for principal oryx/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.254.keytab.
I20260808 09:58:26.859747 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:37799
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.254.keytab
--principal=oryx/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:41263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:37799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:26.944958 3361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:26.945250 3361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:26.945302 3361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:26.946494 3361 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:26.946568 3361 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 09:58:26.946596 3361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:26.946631 3361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:26.946656 3361 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:26.946689 3361 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:26.948361 3361 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:37799
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.254.keytab
--principal=oryx/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:37799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:26.948666 3361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:26.948915 3361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:26.954210 3370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:26.954210 3373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:26.954373 3371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:26.954412 3361 server_base.cc:1034] running on GCE node
I20260808 09:58:26.954892 3361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:26.955211 3361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:26.956390 3361 hybrid_clock.cc:648] HybridClock initialized: now 1786183106956378 us; error 44 us; skew 500 ppm
Aug 08 09:58:26 dist-test-slave-gw5c krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183106, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:26.963517 3361 init.cc:377] Logged in from keytab as oryx/127.24.71.254@KRBTEST.COM (short username oryx)
I20260808 09:58:26.964017 3361 webserver.cc:460] Webserver started at http://127.24.71.254:44449/ using document root <none> and password file <none>
I20260808 09:58:26.964213 3361 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:26.964254 3361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:26.964349 3361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:26.965416 3361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "c4a23bbbe586442abbfd8d42a4706f11"
format_stamp: "Formatted at 2026-08-08 09:58:26 on dist-test-slave-gw5c"
server_key: "addf12e5c767e03871a71bc24660d16e"
server_key_iv: "f9ffe63306faba8a4f7ab99daad9d770"
server_key_version: "encryptionkey@0"
I20260808 09:58:26.965729 3361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "c4a23bbbe586442abbfd8d42a4706f11"
format_stamp: "Formatted at 2026-08-08 09:58:26 on dist-test-slave-gw5c"
server_key: "addf12e5c767e03871a71bc24660d16e"
server_key_iv: "f9ffe63306faba8a4f7ab99daad9d770"
server_key_version: "encryptionkey@0"
I20260808 09:58:26.967099 3361 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:26.967952 3384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:26.968114 3361 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 09:58:26.968214 3361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "c4a23bbbe586442abbfd8d42a4706f11"
format_stamp: "Formatted at 2026-08-08 09:58:26 on dist-test-slave-gw5c"
server_key: "addf12e5c767e03871a71bc24660d16e"
server_key_iv: "f9ffe63306faba8a4f7ab99daad9d770"
server_key_version: "encryptionkey@0"
I20260808 09:58:26.968272 3361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:26.996623 3361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:26.999148 3361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:26.999279 3361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:27.004163 3361 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:37799
I20260808 09:58:27.004266 3472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:37799 every 8 connection(s)
I20260808 09:58:27.004648 3361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:27.005481 3473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:27.005482 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 3361
I20260808 09:58:27.005599 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:27.005822 24863 external_mini_cluster.cc:1428] Setting key 87f538cfed4dca125b8d31e86c4afb44
I20260808 09:58:27.009088 3473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11: Bootstrap starting.
I20260808 09:58:27.009927 3473 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:27.010254 3473 log.cc:824] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:27.011005 3473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11: No bootstrap required, opened a new log
Aug 08 09:58:27 dist-test-slave-gw5c krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
I20260808 09:58:27.013181 3473 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4a23bbbe586442abbfd8d42a4706f11" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37799 } }
I20260808 09:58:27.013348 3473 raft_consensus.cc:374] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:27.013401 3473 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4a23bbbe586442abbfd8d42a4706f11, State: Initialized, Role: FOLLOWER
I20260808 09:58:27.013566 3473 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4a23bbbe586442abbfd8d42a4706f11" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37799 } }
I20260808 09:58:27.013676 3473 raft_consensus.cc:388] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:27.013713 3473 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:27.013763 3473 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:27.014477 3473 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4a23bbbe586442abbfd8d42a4706f11" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37799 } }
I20260808 09:58:27.014616 3473 leader_election.cc:302] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4a23bbbe586442abbfd8d42a4706f11; no voters:
I20260808 09:58:27.014792 3473 leader_election.cc:288] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:27.014825 3478 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:27.015034 3478 raft_consensus.cc:686] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [term 1 LEADER]: Becoming Leader. State: Replica: c4a23bbbe586442abbfd8d42a4706f11, State: Running, Role: LEADER
I20260808 09:58:27.015127 3473 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:27.015234 3478 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4a23bbbe586442abbfd8d42a4706f11" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37799 } }
I20260808 09:58:27.015669 3478 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4a23bbbe586442abbfd8d42a4706f11. Latest consensus state: current_term: 1 leader_uuid: "c4a23bbbe586442abbfd8d42a4706f11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4a23bbbe586442abbfd8d42a4706f11" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37799 } } }
I20260808 09:58:27.015839 3478 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:27.016371 3490 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:27.016986 3490 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:27.017053 3481 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4a23bbbe586442abbfd8d42a4706f11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4a23bbbe586442abbfd8d42a4706f11" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 37799 } } }
I20260808 09:58:27.017175 3481 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:27.017395 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.006550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59580 (local address 127.24.71.254:37799)
0808 09:58:27.006718 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.006726 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.006752 (+ 26us) server_negotiation.cc:407] Connection header received
0808 09:58:27.007213 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.007220 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.007269 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.007383 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:27.008247 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.009153 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.010238 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.010701 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.010832 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.013306 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:27.013310 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:27.013311 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:27.013322 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:27.015498 (+ 2176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.015904 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.015908 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.015908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.016026 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.016272 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.016274 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.016274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.016616 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:27.016790 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.017043 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.017190 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260808 09:58:27.019079 3490 catalog_manager.cc:1347] Generated new cluster ID: 2f3fa1ef2ae94725a1c544a05877a7c8
I20260808 09:58:27.019161 3490 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:27.026448 3490 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:27.026965 3490 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:27.032694 3490 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11: Generated new TSK 0
I20260808 09:58:27.032895 3490 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab.
Entry for principal oryx/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab.
I20260808 09:58:27.066411 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:37799
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab
--principal=oryx/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:41263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:27.173818 3513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:27.174041 3513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:27.174065 3513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:27.175263 3513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:27.175319 3513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:27.175340 3513 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 09:58:27.175359 3513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:27.177003 3513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab
--principal=oryx/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.71.254:37799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:27.177295 3513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:27.177553 3513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:27.182781 3522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:27.182871 3527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:27.182916 3513 server_base.cc:1034] running on GCE node
W20260808 09:58:27.182772 3523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:27.183284 3513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:27.183609 3513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:27.184792 3513 hybrid_clock.cc:648] HybridClock initialized: now 1786183107184772 us; error 43 us; skew 500 ppm
Aug 08 09:58:27 dist-test-slave-gw5c krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183107, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:27.187736 3513 init.cc:377] Logged in from keytab as oryx/127.24.71.193@KRBTEST.COM (short username oryx)
I20260808 09:58:27.188241 3513 webserver.cc:460] Webserver started at http://127.24.71.193:42771/ using document root <none> and password file <none>
I20260808 09:58:27.188520 3513 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:27.188601 3513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:27.188784 3513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:27.189929 3513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "6b1664c210b749a2bbd3b8c71fbb95c4"
format_stamp: "Formatted at 2026-08-08 09:58:27 on dist-test-slave-gw5c"
server_key: "96c9509b0aa44a0886b6b89e7669f600"
server_key_iv: "a7368afa89ee12a200bb230cea483384"
server_key_version: "encryptionkey@0"
I20260808 09:58:27.190341 3513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "6b1664c210b749a2bbd3b8c71fbb95c4"
format_stamp: "Formatted at 2026-08-08 09:58:27 on dist-test-slave-gw5c"
server_key: "96c9509b0aa44a0886b6b89e7669f600"
server_key_iv: "a7368afa89ee12a200bb230cea483384"
server_key_version: "encryptionkey@0"
I20260808 09:58:27.191849 3513 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:27.192673 3537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:27.192870 3513 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:27.192983 3513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "6b1664c210b749a2bbd3b8c71fbb95c4"
format_stamp: "Formatted at 2026-08-08 09:58:27 on dist-test-slave-gw5c"
server_key: "96c9509b0aa44a0886b6b89e7669f600"
server_key_iv: "a7368afa89ee12a200bb230cea483384"
server_key_version: "encryptionkey@0"
I20260808 09:58:27.193063 3513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:27.201045 3513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:27.203181 3513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:27.203310 3513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:27.203905 3513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:27.203945 3513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:27.203974 3513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:27.204013 3513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:27.210561 3513 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:42475
I20260808 09:58:27.210722 3709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:42475 every 8 connection(s)
I20260808 09:58:27.211061 3513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
Aug 08 09:58:27 dist-test-slave-gw5c krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183107, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
I20260808 09:58:27.213111 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 3513
I20260808 09:58:27.213234 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:58:27.213450 24863 external_mini_cluster.cc:1428] Setting key bce37ab1208e6022ac9c92b45c43dc2a
I20260808 09:58:27.215341 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.204511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:47471 (local address 127.24.71.254:37799)
0808 09:58:27.204565 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.204568 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.204787 (+ 219us) server_negotiation.cc:407] Connection header received
0808 09:58:27.205265 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.205267 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.205281 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.205366 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:27.206305 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.207171 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.208793 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.209157 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.209247 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.212136 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:27.212138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:27.212139 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:27.212148 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:27.213759 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.214248 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.214250 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.214250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.214323 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.214573 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.214574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.214574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.214732 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:27.214803 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.215096 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.215204 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 09:58:27.215375 3548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.204478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37799 (local address 127.24.71.193:47471)
0808 09:58:27.204653 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.204690 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.205169 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.205459 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.205462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.205882 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:27.206187 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.206194 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.207293 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.207294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.208691 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.208695 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.209257 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.209258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.209435 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.210098 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:27.210119 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:27.212033 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:27.213843 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.213852 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.213854 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.214159 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.214395 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.214396 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.214396 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.214502 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.214803 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:27.214808 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:27.214927 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.215009 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.215182 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":97,"threads_started":1}
I20260808 09:58:27.216003 3710 heartbeater.cc:347] Connected to a master server at 127.24.71.254:37799
I20260808 09:58:27.216106 3710 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:27.216396 3710 heartbeater.cc:511] Master 127.24.71.254:37799 requested a full tablet report, sending...
I20260808 09:58:27.216984 3403 ts_manager.cc:194] Registered new tserver with Master: 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193:42475)
I20260808 09:58:27.217927 3403 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:47471
I20260808 09:58:27.224754 3722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.217060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37799 (local address 127.24.71.193:52417)
0808 09:58:27.218265 (+ 1205us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.218278 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.218346 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.218483 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.218484 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.218638 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:27.218691 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.218692 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.219678 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.219679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.220270 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.220272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.220778 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.220779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.220829 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.221379 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:27.221384 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:27.221756 (+ 372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:27.223616 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.223617 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.223617 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.223808 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.224048 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.224049 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.224049 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.224108 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.224425 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:27.224426 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:27.224515 (+ 89us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.224596 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.224684 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1181,"thread_start_us":72,"threads_started":1}
I20260808 09:58:27.224825 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.217111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:52417 (local address 127.24.71.254:37799)
0808 09:58:27.217176 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.217178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.218351 (+ 1173us) server_negotiation.cc:407] Connection header received
0808 09:58:27.218403 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.218404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.218416 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.218468 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:27.218763 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.219568 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.220365 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.220698 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.220776 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.221872 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:27.221873 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:27.221874 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:27.221882 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:27.223535 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.223890 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.223891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.223891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.223955 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.224179 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.224180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.224180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.224326 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:27.224423 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.224649 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.224735 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
WARNING: no policy specified for oryx/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab.
Entry for principal oryx/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab.
I20260808 09:58:27.242740 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:37799
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab
--principal=oryx/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:41263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:27.325433 3724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:27.325649 3724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:27.325675 3724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:27.326843 3724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:27.326886 3724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:27.326941 3724 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 09:58:27.326977 3724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:27.328488 3724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab
--principal=oryx/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.71.254:37799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:27.328734 3724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:27.328979 3724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:27.333949 3733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:27.333976 3729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:27.333945 3735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:27.334337 3724 server_base.cc:1034] running on GCE node
I20260808 09:58:27.334592 3724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:27.334846 3724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:27.336015 3724 hybrid_clock.cc:648] HybridClock initialized: now 1786183107335998 us; error 32 us; skew 500 ppm
Aug 08 09:58:27 dist-test-slave-gw5c krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183107, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:27.338749 3724 init.cc:377] Logged in from keytab as oryx/127.24.71.194@KRBTEST.COM (short username oryx)
I20260808 09:58:27.339216 3724 webserver.cc:460] Webserver started at http://127.24.71.194:39467/ using document root <none> and password file <none>
I20260808 09:58:27.339505 3724 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:27.339577 3724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:27.339736 3724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:27.340814 3724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "014925260a3c442f8082c4206116b752"
format_stamp: "Formatted at 2026-08-08 09:58:27 on dist-test-slave-gw5c"
server_key: "89758bd181613b3fcad5990be05ef2ee"
server_key_iv: "7b5c18d31e183231abaf84a5a083475e"
server_key_version: "encryptionkey@0"
I20260808 09:58:27.341192 3724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "014925260a3c442f8082c4206116b752"
format_stamp: "Formatted at 2026-08-08 09:58:27 on dist-test-slave-gw5c"
server_key: "89758bd181613b3fcad5990be05ef2ee"
server_key_iv: "7b5c18d31e183231abaf84a5a083475e"
server_key_version: "encryptionkey@0"
I20260808 09:58:27.342573 3724 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 09:58:27.343300 3745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:27.343493 3724 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 09:58:27.343595 3724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "014925260a3c442f8082c4206116b752"
format_stamp: "Formatted at 2026-08-08 09:58:27 on dist-test-slave-gw5c"
server_key: "89758bd181613b3fcad5990be05ef2ee"
server_key_iv: "7b5c18d31e183231abaf84a5a083475e"
server_key_version: "encryptionkey@0"
I20260808 09:58:27.343676 3724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:27.363265 3724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:27.365240 3724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:27.365414 3724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:27.365974 3724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:27.366047 3724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:27.366093 3724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:27.366120 3724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:27.373392 3724 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:42137
Aug 08 09:58:27 dist-test-slave-gw5c krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183107, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
I20260808 09:58:27.373596 3911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:42137 every 8 connection(s)
I20260808 09:58:27.373931 3724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:58:27.377836 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.366530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:48101 (local address 127.24.71.254:37799)
0808 09:58:27.366591 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.366593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.366797 (+ 204us) server_negotiation.cc:407] Connection header received
0808 09:58:27.367351 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.367352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.367366 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.367482 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:27.368336 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.369174 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.370758 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.371071 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.371140 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.374263 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:27.374265 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:27.374265 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:27.374273 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:27.376184 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.376689 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.376690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.376691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.376755 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.377091 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.377092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.377092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.377234 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:27.377316 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.377648 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.377739 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 09:58:27.378137 3757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.366499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37799 (local address 127.24.71.194:48101)
0808 09:58:27.366678 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.366714 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.367240 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.367560 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.367564 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.367961 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:27.368241 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.368249 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.369290 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.369291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.370678 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.370681 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.371178 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.371179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.371444 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.372005 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:27.372018 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:27.374146 (+ 2128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:27.376295 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.376302 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.376304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.376603 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.376824 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.376825 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.376825 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.376997 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.377307 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:27.377314 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:27.377495 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.377619 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.377830 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
I20260808 09:58:27.378557 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 3724
I20260808 09:58:27.378679 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:58:27.378756 3912 heartbeater.cc:347] Connected to a master server at 127.24.71.254:37799
I20260808 09:58:27.378871 3912 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:27.378949 24863 external_mini_cluster.cc:1428] Setting key a35fa1fbab4b1115e0ffb321ca74d8c4
I20260808 09:58:27.379299 3912 heartbeater.cc:511] Master 127.24.71.254:37799 requested a full tablet report, sending...
I20260808 09:58:27.379709 3404 ts_manager.cc:194] Registered new tserver with Master: 014925260a3c442f8082c4206116b752 (127.24.71.194:42137)
I20260808 09:58:27.380213 3404 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:48101
I20260808 09:58:27.387370 3924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.381568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37799 (local address 127.24.71.194:57721)
0808 09:58:27.381713 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.381724 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.381785 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.381916 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.381916 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.382146 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:27.382214 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.382216 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.382846 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.382847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.383459 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.383462 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.383805 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.383806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.383874 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.384349 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:27.384354 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:27.384655 (+ 301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:27.386258 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.386259 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.386259 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.386440 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.386662 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.386663 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.386664 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.386725 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.387033 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:27.387034 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:27.387081 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.387167 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.387270 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
I20260808 09:58:27.387367 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.381706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:57721 (local address 127.24.71.254:37799)
0808 09:58:27.381752 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.381754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.381766 (+ 12us) server_negotiation.cc:407] Connection header received
0808 09:58:27.381847 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.381847 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.381856 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.381903 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:27.382292 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.382739 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.383541 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.383732 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.383806 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.384766 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:27.384767 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:27.384768 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:27.384775 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:27.386169 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.386531 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.386533 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.386534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.386593 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.386799 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.386800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.386801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.386952 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:27.387031 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.387193 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.387270 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for oryx/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab.
Entry for principal oryx/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab.
I20260808 09:58:27.406601 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:37799
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab
--principal=oryx/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:41263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:27.495164 3927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:27.495371 3927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:27.495450 3927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:27.496659 3927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:27.496701 3927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:27.496722 3927 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 09:58:27.496786 3927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:27.498288 3927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab
--principal=oryx/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.71.254:37799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:27.498534 3927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:27.498787 3927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:27.503875 3938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:27.503895 3940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:27.503923 3936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:27.504287 3927 server_base.cc:1034] running on GCE node
I20260808 09:58:27.504528 3927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:27.504752 3927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:27.505898 3927 hybrid_clock.cc:648] HybridClock initialized: now 1786183107505882 us; error 30 us; skew 500 ppm
Aug 08 09:58:27 dist-test-slave-gw5c krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183107, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:27.508553 3927 init.cc:377] Logged in from keytab as oryx/127.24.71.195@KRBTEST.COM (short username oryx)
I20260808 09:58:27.508955 3927 webserver.cc:460] Webserver started at http://127.24.71.195:38205/ using document root <none> and password file <none>
I20260808 09:58:27.509145 3927 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:27.509188 3927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:27.509282 3927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:27.510295 3927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "eeb327884fd94b2ea5d9d31b28e79772"
format_stamp: "Formatted at 2026-08-08 09:58:27 on dist-test-slave-gw5c"
server_key: "31c233a7800a9d9c0fb32b850c936f69"
server_key_iv: "ed5f210d1e3923bbc51061771d831101"
server_key_version: "encryptionkey@0"
I20260808 09:58:27.510599 3927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "eeb327884fd94b2ea5d9d31b28e79772"
format_stamp: "Formatted at 2026-08-08 09:58:27 on dist-test-slave-gw5c"
server_key: "31c233a7800a9d9c0fb32b850c936f69"
server_key_iv: "ed5f210d1e3923bbc51061771d831101"
server_key_version: "encryptionkey@0"
I20260808 09:58:27.512046 3927 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 09:58:27.512826 3947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:27.513028 3927 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 09:58:27.513118 3927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "eeb327884fd94b2ea5d9d31b28e79772"
format_stamp: "Formatted at 2026-08-08 09:58:27 on dist-test-slave-gw5c"
server_key: "31c233a7800a9d9c0fb32b850c936f69"
server_key_iv: "ed5f210d1e3923bbc51061771d831101"
server_key_version: "encryptionkey@0"
I20260808 09:58:27.513176 3927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:27.520114 3927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:27.522061 3927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:27.522173 3927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:27.522749 3927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:27.522802 3927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:27.522825 3927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:27.522861 3927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 09:58:27 dist-test-slave-gw5c krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183107, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
I20260808 09:58:27.530243 3927 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:42327
I20260808 09:58:27.530328 4115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:42327 every 8 connection(s)
I20260808 09:58:27.530683 3927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:58:27.532552 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 3927
I20260808 09:58:27.532662 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:58:27.532863 24863 external_mini_cluster.cc:1428] Setting key 1be8198daa20b7b6259901af26b94543
I20260808 09:58:27.533675 3961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.523202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37799 (local address 127.24.71.195:55141)
0808 09:58:27.523350 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.523427 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.523900 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.524199 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.524203 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.524568 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:27.524848 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.524854 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.525911 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.525911 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.527270 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.527273 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.527852 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.527854 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.528000 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.528535 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:27.528544 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:27.530061 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:27.531955 (+ 1894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.531962 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.531964 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.532188 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.532443 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.532443 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.532444 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.532555 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.532901 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:27.532909 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:27.533109 (+ 200us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.533250 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.533448 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
I20260808 09:58:27.533977 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.523244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:55141 (local address 127.24.71.254:37799)
0808 09:58:27.523332 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.523335 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.523516 (+ 181us) server_negotiation.cc:407] Connection header received
0808 09:58:27.523995 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.523997 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.524012 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.524098 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:27.524959 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.525801 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.527353 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.527694 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.527774 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.530148 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:27.530149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:27.530150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:27.530158 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:27.531848 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.532285 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.532287 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.532287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.532349 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.532635 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.532636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.532636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.532813 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:27.532909 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.533829 (+ 920us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.533914 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 09:58:27.534340 4116 heartbeater.cc:347] Connected to a master server at 127.24.71.254:37799
I20260808 09:58:27.534430 4116 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:27.534636 4116 heartbeater.cc:511] Master 127.24.71.254:37799 requested a full tablet report, sending...
I20260808 09:58:27.535045 3403 ts_manager.cc:194] Registered new tserver with Master: eeb327884fd94b2ea5d9d31b28e79772 (127.24.71.195:42327)
I20260808 09:58:27.535509 3403 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:55141
I20260808 09:58:27.540988 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.535544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:50079 (local address 127.24.71.254:37799)
0808 09:58:27.535587 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.535588 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.535720 (+ 132us) server_negotiation.cc:407] Connection header received
0808 09:58:27.535769 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.535770 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.535780 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.535836 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:27.536196 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.536653 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.537328 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.537506 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.537557 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.538548 (+ 991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:27.538550 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:27.538550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:27.538556 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:27.540006 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.540359 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.540360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.540360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.540409 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.540584 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.540585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.540585 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.540676 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:27.540725 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.540863 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.540928 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 09:58:27.541002 4122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.535499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37799 (local address 127.24.71.195:50079)
0808 09:58:27.535663 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.535678 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.535730 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.535843 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.535844 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.536059 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:27.536121 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.536123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.536741 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.536742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.537248 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.537249 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.537597 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.537598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.537659 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.538096 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:27.538100 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:27.538459 (+ 359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:27.540081 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.540082 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.540083 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.540289 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.540469 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.540469 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.540470 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.540530 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.540741 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:27.540742 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:27.540780 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.540838 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.540923 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":75,"threads_started":1}
I20260808 09:58:27.544721 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 09:58:27 dist-test-slave-gw5c krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183107, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 09:58:27 dist-test-slave-gw5c krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:27 dist-test-slave-gw5c krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 09:58:27.567382 3476 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:27.561711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59596 (local address 127.24.71.254:37799)
0808 09:58:27.561786 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.561787 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.561798 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:58:27.561866 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.561867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.561878 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.561930 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:27.562488 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.562987 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.563763 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.563961 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.564017 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.567244 (+ 3227us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59596: BlockingRecv error: recv got EOF from 127.0.0.1:59596 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 09:58:27 dist-test-slave-gw5c krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183107, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
I20260808 09:58:27.574959 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.568131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59598 (local address 127.24.71.254:37799)
0808 09:58:27.568205 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.568207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.568244 (+ 37us) server_negotiation.cc:407] Connection header received
0808 09:58:27.568299 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.568300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.568308 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.568348 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:27.568788 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.569252 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.569971 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.570310 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.570380 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.572651 (+ 2271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:27.572653 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:27.572653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:27.572660 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:27.573960 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.574258 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.574258 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.574259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.574314 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.574476 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.574476 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.574476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.574574 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:27.574649 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.574744 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.574817 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 09:58:27.576584 3403 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59598:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:58:27.578140 3403 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:58:27.584988 4153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.580680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:42475 (local address 127.0.0.1:48662)
0808 09:58:27.580882 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.580926 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.580999 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.581369 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.581372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.581374 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:27.581446 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.581448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.582328 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.582329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.583746 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.583749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.584676 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.584677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.584742 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.584753 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.584846 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.584904 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":1,"thread_start_us":75,"threads_started":1}
I20260808 09:58:27.585381 4155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.580828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48662 (local address 127.24.71.193:42475)
0808 09:58:27.581167 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.581172 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.581181 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:27.581223 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.581225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.581242 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.581521 (+ 279us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:27.581569 (+ 48us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.582241 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.583838 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.584590 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.584667 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.584739 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.585193 (+ 454us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.585280 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":80,"threads_started":1}
I20260808 09:58:27.585965 4148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.580699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:42327 (local address 127.0.0.1:39230)
0808 09:58:27.581004 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.581014 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.581056 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.582537 (+ 1481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.582538 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.582540 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:27.582590 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.582592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.583668 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.583669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.584744 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.584748 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.585795 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.585795 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.585842 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.585845 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.585889 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.585917 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":86,"threads_started":1}
I20260808 09:58:27.586086 4154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.580790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39230 (local address 127.24.71.195:42327)
0808 09:58:27.582381 (+ 1591us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.582384 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.582392 (+ 8us) server_negotiation.cc:407] Connection header received
0808 09:58:27.582422 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.582424 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.582435 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.582524 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:27.582683 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.583591 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.584841 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.585610 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.585681 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.585765 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.585930 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.585973 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1559,"thread_start_us":91,"threads_started":1}
I20260808 09:58:27.586124 3609 tablet_service.cc:1467] Processing CreateTablet for tablet 58d5e759917844ebb917ec533e5c2030 (DEFAULT_TABLE table=test-table [id=9f6139ad13f64c46bf88f18b2a4afd46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:27.586556 3609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58d5e759917844ebb917ec533e5c2030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:27.586724 4022 tablet_service.cc:1467] Processing CreateTablet for tablet 58d5e759917844ebb917ec533e5c2030 (DEFAULT_TABLE table=test-table [id=9f6139ad13f64c46bf88f18b2a4afd46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:27.587037 4022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58d5e759917844ebb917ec533e5c2030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:27.587637 4158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.580913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:42137 (local address 127.0.0.1:42956)
0808 09:58:27.581059 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.581070 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.581126 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.581542 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.581543 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.581545 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:27.581602 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.581603 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.582591 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.582592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.583747 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.583749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.585581 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.585582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.587477 (+ 1895us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.587484 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.587527 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.587573 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":23,"thread_start_us":86,"threads_started":1}
I20260808 09:58:27.588040 4159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.581162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42956 (local address 127.24.71.194:42137)
0808 09:58:27.581369 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.581374 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.581385 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:58:27.581426 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.581428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.581442 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.581543 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:27.581660 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.582489 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.584780 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.585481 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.587763 (+ 2282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.587865 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.587895 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.587935 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":144,"threads_started":1}
I20260808 09:58:27.590155 4160 tablet_bootstrap.cc:492] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772: Bootstrap starting.
I20260808 09:58:27.590663 4161 tablet_bootstrap.cc:492] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4: Bootstrap starting.
I20260808 09:58:27.590919 4160 tablet_bootstrap.cc:654] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:27.590930 3825 tablet_service.cc:1467] Processing CreateTablet for tablet 58d5e759917844ebb917ec533e5c2030 (DEFAULT_TABLE table=test-table [id=9f6139ad13f64c46bf88f18b2a4afd46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:27.591305 3825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58d5e759917844ebb917ec533e5c2030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:27.591288 4160 log.cc:824] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:27.591323 4161 tablet_bootstrap.cc:654] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:27.591745 4161 log.cc:824] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:27.592231 4160 tablet_bootstrap.cc:492] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772: No bootstrap required, opened a new log
I20260808 09:58:27.592321 4160 ts_tablet_manager.cc:1397] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:58:27.592517 4161 tablet_bootstrap.cc:492] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4: No bootstrap required, opened a new log
I20260808 09:58:27.592605 4161 ts_tablet_manager.cc:1397] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 09:58:27.593974 4161 raft_consensus.cc:348] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } }
I20260808 09:58:27.594139 4161 raft_consensus.cc:374] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:27.594185 4161 raft_consensus.cc:729] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1664c210b749a2bbd3b8c71fbb95c4, State: Initialized, Role: FOLLOWER
I20260808 09:58:27.594311 4161 consensus_queue.cc:260] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } }
I20260808 09:58:27.594607 4161 ts_tablet_manager.cc:1428] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 09:58:27.594630 3710 heartbeater.cc:503] Master 127.24.71.254:37799 was elected leader, sending a full tablet report...
I20260808 09:58:27.594473 4160 raft_consensus.cc:348] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } }
I20260808 09:58:27.594971 4160 raft_consensus.cc:374] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:27.595021 4160 raft_consensus.cc:729] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeb327884fd94b2ea5d9d31b28e79772, State: Initialized, Role: FOLLOWER
I20260808 09:58:27.595140 4160 consensus_queue.cc:260] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } }
I20260808 09:58:27.595372 4169 tablet_bootstrap.cc:492] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752: Bootstrap starting.
I20260808 09:58:27.595475 4160 ts_tablet_manager.cc:1428] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 09:58:27.595736 4116 heartbeater.cc:503] Master 127.24.71.254:37799 was elected leader, sending a full tablet report...
I20260808 09:58:27.596102 4169 tablet_bootstrap.cc:654] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:27.596437 4169 log.cc:824] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:27.597184 4169 tablet_bootstrap.cc:492] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752: No bootstrap required, opened a new log
I20260808 09:58:27.597241 4169 ts_tablet_manager.cc:1397] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 09:58:27.598500 4169 raft_consensus.cc:348] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } }
I20260808 09:58:27.598618 4169 raft_consensus.cc:374] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:27.598639 4169 raft_consensus.cc:729] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 014925260a3c442f8082c4206116b752, State: Initialized, Role: FOLLOWER
I20260808 09:58:27.598750 4169 consensus_queue.cc:260] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } }
I20260808 09:58:27.599040 4169 ts_tablet_manager.cc:1428] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 09:58:27.599052 3912 heartbeater.cc:503] Master 127.24.71.254:37799 was elected leader, sending a full tablet report...
W20260808 09:58:27.626369 3913 tablet.cc:2369] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 09:58:27.626672 4171 raft_consensus.cc:482] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:27.626827 4171 raft_consensus.cc:504] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } }
I20260808 09:58:27.627300 4171 leader_election.cc:288] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193:42475), 014925260a3c442f8082c4206116b752 (127.24.71.194:42137)
I20260808 09:58:27.630193 4159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.627644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:42513 (local address 127.24.71.194:42137)
0808 09:58:27.627690 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.627692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.627701 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:27.627776 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.627777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.627786 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.627859 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:27.628024 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.628506 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.629451 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.629815 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.629914 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.629924 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.630094 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.630129 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 09:58:27.630193 3961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.627591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:42137 (local address 127.24.71.195:42513)
0808 09:58:27.627648 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.627660 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.627707 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.627866 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.627867 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.627869 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:27.627949 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.627951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.628593 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.628595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.629342 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.629344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.629904 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.629905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.630006 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.630009 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.630075 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.630117 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 09:58:27.630545 4155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.627595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:58261 (local address 127.24.71.193:42475)
0808 09:58:27.627665 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.627667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.627908 (+ 241us) server_negotiation.cc:407] Connection header received
0808 09:58:27.627992 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.627993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.628003 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.628082 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:27.628278 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.628762 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.629720 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.630103 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.630193 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.630202 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.630438 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.630490 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 09:58:27.630550 3850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d5e759917844ebb917ec533e5c2030" candidate_uuid: "eeb327884fd94b2ea5d9d31b28e79772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "014925260a3c442f8082c4206116b752" is_pre_election: true
I20260808 09:58:27.630728 3850 raft_consensus.cc:2454] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeb327884fd94b2ea5d9d31b28e79772 in term 0.
I20260808 09:58:27.630836 4175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.627607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:42475 (local address 127.24.71.195:58261)
0808 09:58:27.627815 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.627833 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.627918 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.628100 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.628101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.628102 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:27.628194 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.628196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.628866 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.628867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.629609 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.629612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.630220 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.630221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.630292 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.630297 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.630679 (+ 382us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.630739 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":13,"thread_start_us":152,"threads_started":1}
I20260808 09:58:27.630988 3951 leader_election.cc:302] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 014925260a3c442f8082c4206116b752, eeb327884fd94b2ea5d9d31b28e79772; no voters:
I20260808 09:58:27.631142 4171 raft_consensus.cc:2781] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:58:27.631207 4171 raft_consensus.cc:482] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:58:27.631225 4171 raft_consensus.cc:3037] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:27.631253 3635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d5e759917844ebb917ec533e5c2030" candidate_uuid: "eeb327884fd94b2ea5d9d31b28e79772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" is_pre_election: true
I20260808 09:58:27.631464 3635 raft_consensus.cc:2454] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeb327884fd94b2ea5d9d31b28e79772 in term 0.
I20260808 09:58:27.632329 4171 raft_consensus.cc:504] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } }
I20260808 09:58:27.632489 4171 leader_election.cc:288] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193:42475), 014925260a3c442f8082c4206116b752 (127.24.71.194:42137)
I20260808 09:58:27.632627 3635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d5e759917844ebb917ec533e5c2030" candidate_uuid: "eeb327884fd94b2ea5d9d31b28e79772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4"
I20260808 09:58:27.632637 3850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d5e759917844ebb917ec533e5c2030" candidate_uuid: "eeb327884fd94b2ea5d9d31b28e79772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "014925260a3c442f8082c4206116b752"
I20260808 09:58:27.632752 3635 raft_consensus.cc:3037] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:27.632747 3850 raft_consensus.cc:3037] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:27.633459 3850 raft_consensus.cc:2454] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeb327884fd94b2ea5d9d31b28e79772 in term 1.
I20260808 09:58:27.633605 3635 raft_consensus.cc:2454] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeb327884fd94b2ea5d9d31b28e79772 in term 1.
I20260808 09:58:27.633639 3951 leader_election.cc:302] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 014925260a3c442f8082c4206116b752, eeb327884fd94b2ea5d9d31b28e79772; no voters:
I20260808 09:58:27.633723 4171 raft_consensus.cc:2781] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:27.633906 4171 raft_consensus.cc:686] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [term 1 LEADER]: Becoming Leader. State: Replica: eeb327884fd94b2ea5d9d31b28e79772, State: Running, Role: LEADER
I20260808 09:58:27.634027 4171 consensus_queue.cc:237] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } }
I20260808 09:58:27.635079 3404 catalog_manager.cc:5495] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 reported cstate change: term changed from 0 to 1, leader changed from <none> to eeb327884fd94b2ea5d9d31b28e79772 (127.24.71.195). New cstate: current_term: 1 leader_uuid: "eeb327884fd94b2ea5d9d31b28e79772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260808 09:58:27.642119 4154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.639853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39240 (local address 127.24.71.195:42327)
0808 09:58:27.639918 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.639920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.639930 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:27.639971 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.639972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.639989 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.640050 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:27.640185 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.640637 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.641401 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.641583 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.641638 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.641794 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:27.641895 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:27.641954 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.642006 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.642023 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 09:58:27.643988 3635 raft_consensus.cc:1261] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Refusing update from remote peer eeb327884fd94b2ea5d9d31b28e79772: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:27.644054 3850 raft_consensus.cc:1261] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Refusing update from remote peer eeb327884fd94b2ea5d9d31b28e79772: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:27.644344 4171 consensus_queue.cc:1035] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:27.644492 4176 consensus_queue.cc:1035] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:27.646901 4179 mvcc.cc:205] Tried to move back new op lower bound from 7316206008906846208 to 7316206008870047744. Current Snapshot: MvccSnapshot[applied={T|T < 7316206008906846208}]
I20260808 09:58:27.648052 4182 mvcc.cc:205] Tried to move back new op lower bound from 7316206008906846208 to 7316206008870047744. Current Snapshot: MvccSnapshot[applied={T|T < 7316206008906846208}]
I20260808 09:58:27.649425 3404 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:27.649520 3404 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:27.650274 3404 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11: Sending DeleteTablet for 3 replicas of tablet 58d5e759917844ebb917ec533e5c2030
I20260808 09:58:27.650622 4022 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d5e759917844ebb917ec533e5c2030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:27 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:39230
I20260808 09:58:27.650677 3609 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d5e759917844ebb917ec533e5c2030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:27 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:48662
I20260808 09:58:27.650825 3825 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d5e759917844ebb917ec533e5c2030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:27 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:42956
I20260808 09:58:27.650928 4196 tablet_replica.cc:330] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4: stopping tablet replica
I20260808 09:58:27.651033 4196 raft_consensus.cc:2229] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:27.651137 4196 raft_consensus.cc:2258] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:27.651144 3404 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59598:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:58:27.651300 3404 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:58:27.651490 4197 tablet_replica.cc:330] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752: stopping tablet replica
I20260808 09:58:27.651678 4196 ts_tablet_manager.cc:1905] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:27.651173 4194 tablet_replica.cc:330] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772: stopping tablet replica
I20260808 09:58:27.651875 4194 raft_consensus.cc:2229] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [term 1 LEADER]: Raft consensus shutting down.
I20260808 09:58:27.651979 4194 raft_consensus.cc:2258] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:27.652128 4197 raft_consensus.cc:2229] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:27.652252 4197 raft_consensus.cc:2258] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:27.652470 4194 ts_tablet_manager.cc:1905] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:27.652784 4197 ts_tablet_manager.cc:1905] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:27.652824 3825 tablet_service.cc:1467] Processing CreateTablet for tablet e2d32a5387594333b46a8a79859eb2b9 (DEFAULT_TABLE table=test-table [id=865e0c9e0c114185af513ab18fb515d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:27.652969 3825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d32a5387594333b46a8a79859eb2b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:27.654413 4169 tablet_bootstrap.cc:492] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752: Bootstrap starting.
I20260808 09:58:27.654488 4022 tablet_service.cc:1467] Processing CreateTablet for tablet e2d32a5387594333b46a8a79859eb2b9 (DEFAULT_TABLE table=test-table [id=865e0c9e0c114185af513ab18fb515d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:27.654748 4022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d32a5387594333b46a8a79859eb2b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:27.654826 4169 tablet_bootstrap.cc:654] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:27.652729 3609 tablet_service.cc:1467] Processing CreateTablet for tablet e2d32a5387594333b46a8a79859eb2b9 (DEFAULT_TABLE table=test-table [id=865e0c9e0c114185af513ab18fb515d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:27.655217 3609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d32a5387594333b46a8a79859eb2b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:27.656163 4160 tablet_bootstrap.cc:492] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772: Bootstrap starting.
I20260808 09:58:27.656384 4194 ts_tablet_manager.cc:1918] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:27.656538 4194 log.cc:1196] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/58d5e759917844ebb917ec533e5c2030
I20260808 09:58:27.656580 4160 tablet_bootstrap.cc:654] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:27.656682 4161 tablet_bootstrap.cc:492] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4: Bootstrap starting.
I20260808 09:58:27.656875 4196 ts_tablet_manager.cc:1918] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:27.656973 4196 log.cc:1196] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/wal/wals/58d5e759917844ebb917ec533e5c2030
I20260808 09:58:27.657101 4161 tablet_bootstrap.cc:654] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:27.657116 4194 ts_tablet_manager.cc:1939] T 58d5e759917844ebb917ec533e5c2030 P eeb327884fd94b2ea5d9d31b28e79772: Deleting consensus metadata
I20260808 09:58:27.657241 4196 ts_tablet_manager.cc:1939] T 58d5e759917844ebb917ec533e5c2030 P 6b1664c210b749a2bbd3b8c71fbb95c4: Deleting consensus metadata
I20260808 09:58:27.657645 3387 catalog_manager.cc:4841] TS eeb327884fd94b2ea5d9d31b28e79772 (127.24.71.195:42327): tablet 58d5e759917844ebb917ec533e5c2030 (table test-table [id=9f6139ad13f64c46bf88f18b2a4afd46]) successfully deleted
I20260808 09:58:27.657698 3385 catalog_manager.cc:4841] TS 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193:42475): tablet 58d5e759917844ebb917ec533e5c2030 (table test-table [id=9f6139ad13f64c46bf88f18b2a4afd46]) successfully deleted
I20260808 09:58:27.657789 4197 ts_tablet_manager.cc:1918] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:27.657876 4197 log.cc:1196] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/58d5e759917844ebb917ec533e5c2030
I20260808 09:58:27.658157 4197 ts_tablet_manager.cc:1939] T 58d5e759917844ebb917ec533e5c2030 P 014925260a3c442f8082c4206116b752: Deleting consensus metadata
I20260808 09:58:27.658600 3387 catalog_manager.cc:4841] TS 014925260a3c442f8082c4206116b752 (127.24.71.194:42137): tablet 58d5e759917844ebb917ec533e5c2030 (table test-table [id=9f6139ad13f64c46bf88f18b2a4afd46]) successfully deleted
I20260808 09:58:27.658861 4161 tablet_bootstrap.cc:492] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4: No bootstrap required, opened a new log
I20260808 09:58:27.658938 4161 ts_tablet_manager.cc:1397] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 09:58:27.659049 4169 tablet_bootstrap.cc:492] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752: No bootstrap required, opened a new log
I20260808 09:58:27.659109 4169 ts_tablet_manager.cc:1397] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260808 09:58:27.659147 4161 raft_consensus.cc:348] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.659265 4161 raft_consensus.cc:374] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:27.659293 4161 raft_consensus.cc:729] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1664c210b749a2bbd3b8c71fbb95c4, State: Initialized, Role: FOLLOWER
I20260808 09:58:27.659266 4169 raft_consensus.cc:348] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.659360 4169 raft_consensus.cc:374] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:27.659341 4161 consensus_queue.cc:260] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.659417 4169 raft_consensus.cc:729] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 014925260a3c442f8082c4206116b752, State: Initialized, Role: FOLLOWER
I20260808 09:58:27.659471 4161 ts_tablet_manager.cc:1428] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:27.659462 4169 consensus_queue.cc:260] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.659552 4169 ts_tablet_manager.cc:1428] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 09:58:27.667052 4160 tablet_bootstrap.cc:492] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772: No bootstrap required, opened a new log
I20260808 09:58:27.667133 4160 ts_tablet_manager.cc:1397] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20260808 09:58:27.667325 4160 raft_consensus.cc:348] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.667439 4160 raft_consensus.cc:374] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:27.667464 4160 raft_consensus.cc:729] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeb327884fd94b2ea5d9d31b28e79772, State: Initialized, Role: FOLLOWER
I20260808 09:58:27.667517 4160 consensus_queue.cc:260] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.667615 4160 ts_tablet_manager.cc:1428] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
W20260808 09:58:27.711822 3711 tablet.cc:2369] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 09:58:27.781246 4117 tablet.cc:2369] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 09:58:27.819700 4174 raft_consensus.cc:482] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:27.819811 4174 raft_consensus.cc:504] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.820148 4174 leader_election.cc:288] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193:42475), eeb327884fd94b2ea5d9d31b28e79772 (127.24.71.195:42327)
I20260808 09:58:27.823077 3757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.820328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:42475 (local address 127.24.71.194:36093)
0808 09:58:27.820411 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.820425 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.820478 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.820643 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.820643 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.820645 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:27.820723 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.820724 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.821381 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.821382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.822188 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.822191 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.822744 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.822745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.822886 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.822890 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.822946 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.822991 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":29}
I20260808 09:58:27.823194 4155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.820459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:36093 (local address 127.24.71.193:42475)
0808 09:58:27.820510 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.820512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.820526 (+ 14us) server_negotiation.cc:407] Connection header received
0808 09:58:27.820557 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.820557 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.820567 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.820623 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:27.820803 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.821293 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.822297 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.822660 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.822747 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.822757 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.823045 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.823118 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 09:58:27.823186 4154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.820494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:50555 (local address 127.24.71.195:42327)
0808 09:58:27.820545 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.820547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.820600 (+ 53us) server_negotiation.cc:407] Connection header received
0808 09:58:27.820669 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.820670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.820682 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.820783 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:27.820961 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.821423 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.822398 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.822768 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.822856 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.822866 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.823046 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.823089 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 09:58:27.823297 4201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.820399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:42327 (local address 127.24.71.194:50555)
0808 09:58:27.820534 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.820545 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.820610 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.820790 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.820791 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.820793 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:27.820883 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.820885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.821510 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.821511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.822296 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.822298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.822872 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.822874 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.822939 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.822945 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.823028 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.823072 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":62,"threads_started":1}
I20260808 09:58:27.823529 3635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d32a5387594333b46a8a79859eb2b9" candidate_uuid: "014925260a3c442f8082c4206116b752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" is_pre_election: true
I20260808 09:58:27.823638 3635 raft_consensus.cc:2454] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 014925260a3c442f8082c4206116b752 in term 0.
I20260808 09:58:27.823729 4047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d32a5387594333b46a8a79859eb2b9" candidate_uuid: "014925260a3c442f8082c4206116b752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeb327884fd94b2ea5d9d31b28e79772" is_pre_election: true
I20260808 09:58:27.823887 4047 raft_consensus.cc:2454] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 014925260a3c442f8082c4206116b752 in term 0.
I20260808 09:58:27.824146 3750 leader_election.cc:302] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 014925260a3c442f8082c4206116b752, 6b1664c210b749a2bbd3b8c71fbb95c4, eeb327884fd94b2ea5d9d31b28e79772; no voters:
I20260808 09:58:27.824353 4174 raft_consensus.cc:2781] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:58:27.824425 4174 raft_consensus.cc:482] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:58:27.824442 4174 raft_consensus.cc:3037] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:27.825168 4174 raft_consensus.cc:504] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.825314 4174 leader_election.cc:288] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193:42475), eeb327884fd94b2ea5d9d31b28e79772 (127.24.71.195:42327)
I20260808 09:58:27.825477 4047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d32a5387594333b46a8a79859eb2b9" candidate_uuid: "014925260a3c442f8082c4206116b752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeb327884fd94b2ea5d9d31b28e79772"
I20260808 09:58:27.825488 3635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d32a5387594333b46a8a79859eb2b9" candidate_uuid: "014925260a3c442f8082c4206116b752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4"
I20260808 09:58:27.825562 3635 raft_consensus.cc:3037] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:27.825574 4047 raft_consensus.cc:3037] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:27.826225 4047 raft_consensus.cc:2454] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 014925260a3c442f8082c4206116b752 in term 1.
I20260808 09:58:27.826220 3635 raft_consensus.cc:2454] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 014925260a3c442f8082c4206116b752 in term 1.
I20260808 09:58:27.826469 3746 leader_election.cc:302] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 014925260a3c442f8082c4206116b752, 6b1664c210b749a2bbd3b8c71fbb95c4; no voters:
I20260808 09:58:27.826571 4174 raft_consensus.cc:2781] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:27.826742 4174 raft_consensus.cc:686] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [term 1 LEADER]: Becoming Leader. State: Replica: 014925260a3c442f8082c4206116b752, State: Running, Role: LEADER
I20260808 09:58:27.826828 4174 consensus_queue.cc:237] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.827602 3403 catalog_manager.cc:5495] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 reported cstate change: term changed from 0 to 1, leader changed from <none> to 014925260a3c442f8082c4206116b752 (127.24.71.194). New cstate: current_term: 1 leader_uuid: "014925260a3c442f8082c4206116b752" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } health_report { overall_health: UNKNOWN } } }
Aug 08 09:58:27 dist-test-slave-gw5c krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183106, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.254@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
I20260808 09:58:27.871724 4214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.864289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:37799 (local address 127.0.0.1:59606)
0808 09:58:27.864477 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.864488 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.864557 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.864683 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.864683 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.864989 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:27.865038 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.865039 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.865672 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.865672 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.866188 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.866190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.866622 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.866623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.866677 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.867369 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:27.867374 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:27.868969 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:27.870530 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.870537 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.870539 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.870747 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.870963 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:27.870964 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:27.870964 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:27.871077 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:27.871337 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:27.871344 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:27.871462 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.871515 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.871650 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":71,"threads_started":1}
I20260808 09:58:27.871824 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.864361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59606 (local address 127.24.71.254:37799)
0808 09:58:27.864476 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.864478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.864554 (+ 76us) server_negotiation.cc:407] Connection header received
0808 09:58:27.864602 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.864603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.864612 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.864664 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:27.865106 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.865602 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.866299 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.866523 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.866593 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.869056 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:27.869057 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:27.869058 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:27.869064 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:27.870409 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.870822 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.870823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.870823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.870876 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:27.871139 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:27.871140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:27.871140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:27.871267 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:27.871320 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.871550 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.871702 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":62}
I20260808 09:58:27.873770 3403 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:59606:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 09:58:27.874007 3403 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:58:27.875610 3609 tablet_service.cc:1467] Processing CreateTablet for tablet 10c2e8751b954eba9017576fdd264c9d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=363b876a570b4418935393af222dcdc6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 09:58:27.875627 3825 tablet_service.cc:1467] Processing CreateTablet for tablet 10c2e8751b954eba9017576fdd264c9d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=363b876a570b4418935393af222dcdc6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 09:58:27.875641 4022 tablet_service.cc:1467] Processing CreateTablet for tablet 10c2e8751b954eba9017576fdd264c9d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=363b876a570b4418935393af222dcdc6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 09:58:27.875795 4022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10c2e8751b954eba9017576fdd264c9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:27.875793 3609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10c2e8751b954eba9017576fdd264c9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:27.875803 3825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10c2e8751b954eba9017576fdd264c9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:27.877115 4169 tablet_bootstrap.cc:492] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752: Bootstrap starting.
I20260808 09:58:27.877329 4161 tablet_bootstrap.cc:492] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4: Bootstrap starting.
I20260808 09:58:27.877336 4160 tablet_bootstrap.cc:492] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772: Bootstrap starting.
I20260808 09:58:27.877568 4169 tablet_bootstrap.cc:654] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:27.877656 4160 tablet_bootstrap.cc:654] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:27.877740 4161 tablet_bootstrap.cc:654] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:27.878283 4160 tablet_bootstrap.cc:492] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772: No bootstrap required, opened a new log
I20260808 09:58:27.878342 4160 ts_tablet_manager.cc:1397] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:27.878451 4161 tablet_bootstrap.cc:492] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4: No bootstrap required, opened a new log
I20260808 09:58:27.878485 4161 ts_tablet_manager.cc:1397] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:27.878486 4169 tablet_bootstrap.cc:492] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752: No bootstrap required, opened a new log
I20260808 09:58:27.878479 4160 raft_consensus.cc:348] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.878554 4160 raft_consensus.cc:374] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:27.878551 4169 ts_tablet_manager.cc:1397] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:27.878576 4160 raft_consensus.cc:729] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeb327884fd94b2ea5d9d31b28e79772, State: Initialized, Role: FOLLOWER
I20260808 09:58:27.878633 4160 consensus_queue.cc:260] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.878644 4161 raft_consensus.cc:348] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.878712 4161 raft_consensus.cc:374] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:27.878726 4160 ts_tablet_manager.cc:1428] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:27.878733 4161 raft_consensus.cc:729] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1664c210b749a2bbd3b8c71fbb95c4, State: Initialized, Role: FOLLOWER
I20260808 09:58:27.878691 4169 raft_consensus.cc:348] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.878758 4169 raft_consensus.cc:374] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:27.878784 4169 raft_consensus.cc:729] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 014925260a3c442f8082c4206116b752, State: Initialized, Role: FOLLOWER
I20260808 09:58:27.878779 4161 consensus_queue.cc:260] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.878757 4176 tablet_replica.cc:439] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } }
I20260808 09:58:27.878830 4169 consensus_queue.cc:260] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.878842 4176 tablet_replica.cc:442] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:58:27.878865 4161 ts_tablet_manager.cc:1428] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:27.878927 4169 ts_tablet_manager.cc:1428] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:27.878957 4174 tablet_replica.cc:439] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } }
I20260808 09:58:27.879050 4174 tablet_replica.cc:442] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:58:27.879117 4168 tablet_replica.cc:439] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } }
I20260808 09:58:27.879215 4168 tablet_replica.cc:442] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:58:27.982141 4176 raft_consensus.cc:482] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:27.982264 4176 raft_consensus.cc:504] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.982550 4176 leader_election.cc:288] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193:42475), 014925260a3c442f8082c4206116b752 (127.24.71.194:42137)
I20260808 09:58:27.982811 3635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10c2e8751b954eba9017576fdd264c9d" candidate_uuid: "eeb327884fd94b2ea5d9d31b28e79772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" is_pre_election: true
I20260808 09:58:27.982811 3850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10c2e8751b954eba9017576fdd264c9d" candidate_uuid: "eeb327884fd94b2ea5d9d31b28e79772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "014925260a3c442f8082c4206116b752" is_pre_election: true
I20260808 09:58:27.982928 3850 raft_consensus.cc:2454] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeb327884fd94b2ea5d9d31b28e79772 in term 0.
I20260808 09:58:27.982928 3635 raft_consensus.cc:2454] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeb327884fd94b2ea5d9d31b28e79772 in term 0.
I20260808 09:58:27.983086 3948 leader_election.cc:302] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1664c210b749a2bbd3b8c71fbb95c4, eeb327884fd94b2ea5d9d31b28e79772; no voters:
I20260808 09:58:27.983242 4176 raft_consensus.cc:2781] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:58:27.983297 4176 raft_consensus.cc:482] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:58:27.983327 4176 raft_consensus.cc:3037] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:27.984066 4176 raft_consensus.cc:504] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.984220 4176 leader_election.cc:288] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193:42475), 014925260a3c442f8082c4206116b752 (127.24.71.194:42137)
I20260808 09:58:27.984417 3850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10c2e8751b954eba9017576fdd264c9d" candidate_uuid: "eeb327884fd94b2ea5d9d31b28e79772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "014925260a3c442f8082c4206116b752"
I20260808 09:58:27.984422 3635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10c2e8751b954eba9017576fdd264c9d" candidate_uuid: "eeb327884fd94b2ea5d9d31b28e79772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4"
I20260808 09:58:27.984496 3850 raft_consensus.cc:3037] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:27.984517 3635 raft_consensus.cc:3037] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:27.985121 3850 raft_consensus.cc:2454] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeb327884fd94b2ea5d9d31b28e79772 in term 1.
I20260808 09:58:27.985152 3635 raft_consensus.cc:2454] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeb327884fd94b2ea5d9d31b28e79772 in term 1.
I20260808 09:58:27.985306 3951 leader_election.cc:302] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 014925260a3c442f8082c4206116b752, eeb327884fd94b2ea5d9d31b28e79772; no voters:
I20260808 09:58:27.985446 4176 raft_consensus.cc:2781] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:27.985517 4176 raft_consensus.cc:686] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [term 1 LEADER]: Becoming Leader. State: Replica: eeb327884fd94b2ea5d9d31b28e79772, State: Running, Role: LEADER
I20260808 09:58:27.985570 4176 consensus_queue.cc:237] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:27.985862 4171 tablet_replica.cc:439] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772: TxnStatusTablet state changed. Reason: New leader eeb327884fd94b2ea5d9d31b28e79772. Latest consensus state: current_term: 1 leader_uuid: "eeb327884fd94b2ea5d9d31b28e79772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } }
I20260808 09:58:27.985960 4171 tablet_replica.cc:442] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772: This TxnStatusTablet replica's current role is: LEADER
I20260808 09:58:27.986195 4221 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 09:58:27.986238 3404 catalog_manager.cc:5495] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 reported cstate change: term changed from 0 to 1, leader changed from <none> to eeb327884fd94b2ea5d9d31b28e79772 (127.24.71.195). New cstate: current_term: 1 leader_uuid: "eeb327884fd94b2ea5d9d31b28e79772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } health_report { overall_health: HEALTHY } } }
I20260808 09:58:27.986330 4221 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 09:58:27.997253 4214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.994493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:42327 (local address 127.0.0.1:39246)
0808 09:58:27.994577 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:27.994591 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:27.994651 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:27.994796 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:27.994797 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:27.994798 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 09:58:27.994844 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.994845 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.995746 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.995747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.996375 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:27.996377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.996854 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.996855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:27.996908 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.996924 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 09:58:27.997106 (+ 182us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 09:58:27.997113 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 09:58:27.997150 (+ 37us) client_negotiation.cc:240] Negotiation successful
0808 09:58:27.997193 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 09:58:27.997254 4154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:27.994582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39246 (local address 127.24.71.195:42327)
0808 09:58:27.994653 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:27.994655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:27.994666 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:58:27.994722 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:27.994723 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:27.994734 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:27.994792 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:27.994882 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.995674 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.996470 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:27.996772 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:27.996836 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:27.997012 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:27.997046 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:27.997099 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:27.997153 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 09:58:27.997175 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 09:58:27.998263 3850 raft_consensus.cc:1261] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Refusing update from remote peer eeb327884fd94b2ea5d9d31b28e79772: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:27.998262 3635 raft_consensus.cc:1261] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Refusing update from remote peer eeb327884fd94b2ea5d9d31b28e79772: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:27.998503 4176 consensus_queue.cc:1035] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:27.998641 4171 consensus_queue.cc:1035] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:27.999187 4174 tablet_replica.cc:439] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752: TxnStatusTablet state changed. Reason: New leader eeb327884fd94b2ea5d9d31b28e79772. Latest consensus state: current_term: 1 leader_uuid: "eeb327884fd94b2ea5d9d31b28e79772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } }
I20260808 09:58:27.999191 4168 tablet_replica.cc:439] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4: TxnStatusTablet state changed. Reason: New leader eeb327884fd94b2ea5d9d31b28e79772. Latest consensus state: current_term: 1 leader_uuid: "eeb327884fd94b2ea5d9d31b28e79772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } }
I20260808 09:58:27.999279 4174 tablet_replica.cc:442] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:58:27.999287 4168 tablet_replica.cc:442] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:58:28.000160 4176 tablet_replica.cc:439] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eeb327884fd94b2ea5d9d31b28e79772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } }
I20260808 09:58:28.000242 4171 tablet_replica.cc:439] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eeb327884fd94b2ea5d9d31b28e79772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } }
I20260808 09:58:28.000301 4171 tablet_replica.cc:442] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772: This TxnStatusTablet replica's current role is: LEADER
I20260808 09:58:28.000252 4176 tablet_replica.cc:442] T 10c2e8751b954eba9017576fdd264c9d P eeb327884fd94b2ea5d9d31b28e79772: This TxnStatusTablet replica's current role is: LEADER
I20260808 09:58:28.000849 4174 tablet_replica.cc:439] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eeb327884fd94b2ea5d9d31b28e79772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } }
I20260808 09:58:28.000950 4174 tablet_replica.cc:442] T 10c2e8751b954eba9017576fdd264c9d P 014925260a3c442f8082c4206116b752: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:58:28.001094 4180 mvcc.cc:205] Tried to move back new op lower bound from 7316206010359050240 to 7316206010309222400. Current Snapshot: MvccSnapshot[applied={T|T < 7316206010359050240 or (T in {7316206010359050240})}]
I20260808 09:58:28.001210 4168 tablet_replica.cc:439] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eeb327884fd94b2ea5d9d31b28e79772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } } }
I20260808 09:58:28.001281 4168 tablet_replica.cc:442] T 10c2e8751b954eba9017576fdd264c9d P 6b1664c210b749a2bbd3b8c71fbb95c4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 09:58:28.004730 4159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.001912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42970 (local address 127.24.71.194:42137)
0808 09:58:28.001986 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:28.001988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:28.001995 (+ 7us) server_negotiation.cc:407] Connection header received
0808 09:58:28.002033 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:28.002034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:28.002049 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:28.002130 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:28.002276 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.003007 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.003786 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.004113 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.004184 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.004355 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:28.004484 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:28.004561 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:28.004621 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 09:58:28.004644 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 09:58:28.009892 4230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.007194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:42327 (local address 127.24.71.194:56925)
0808 09:58:28.007357 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:28.007371 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:28.007483 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:28.007623 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:28.007623 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:28.007624 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 09:58:28.007677 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:28.007679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.008524 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.008524 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:28.009079 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:28.009080 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.009541 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.009541 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:28.009587 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.009600 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 09:58:28.009768 (+ 168us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 09:58:28.009770 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 09:58:28.009804 (+ 34us) client_negotiation.cc:240] Negotiation successful
0808 09:58:28.009836 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260808 09:58:28.009902 4154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.007271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:56925 (local address 127.24.71.195:42327)
0808 09:58:28.007334 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:28.007336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:28.007469 (+ 133us) server_negotiation.cc:407] Connection header received
0808 09:58:28.007548 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:28.007549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:28.007562 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:28.007614 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:28.007737 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.008445 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.009162 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.009459 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.009528 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.009678 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:28.009710 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:28.009762 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:28.009807 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 09:58:28.009828 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 09:58:28.012670 3635 raft_consensus.cc:1261] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Refusing update from remote peer 014925260a3c442f8082c4206116b752: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:28.012742 4047 raft_consensus.cc:1261] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Refusing update from remote peer 014925260a3c442f8082c4206116b752: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:28.013032 4203 consensus_queue.cc:1035] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:28.013195 4174 consensus_queue.cc:1035] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:28.022264 4159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.019657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:39551 (local address 127.24.71.194:42137)
0808 09:58:28.019715 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:28.019717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:28.019726 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:28.019789 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:28.019790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:28.019800 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:28.019840 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:28.019954 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.020396 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.021466 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.021749 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.021817 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.022018 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:28.022049 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:28.022105 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:28.022181 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 09:58:28.022200 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 09:58:28.022306 4122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.019596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:42137 (local address 127.24.71.195:39551)
0808 09:58:28.019676 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:28.019689 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:28.019734 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:28.019851 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:28.019852 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:28.019853 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 09:58:28.019901 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:28.019902 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.020472 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.020473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:28.021383 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:28.021385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.021828 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.021829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:28.021890 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.021906 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 09:58:28.022122 (+ 216us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 09:58:28.022124 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 09:58:28.022180 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 09:58:28.022228 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 09:58:28.035908 3404 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:28.036036 3404 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:28.036764 3404 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11: Sending DeleteTablet for 3 replicas of tablet e2d32a5387594333b46a8a79859eb2b9
I20260808 09:58:28.037021 3825 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d32a5387594333b46a8a79859eb2b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:28 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:42956
I20260808 09:58:28.037133 4197 tablet_replica.cc:330] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752: stopping tablet replica
I20260808 09:58:28.037150 3609 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d32a5387594333b46a8a79859eb2b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:28 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:48662
I20260808 09:58:28.037211 4197 raft_consensus.cc:2229] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [term 1 LEADER]: Raft consensus shutting down.
I20260808 09:58:28.037258 4196 tablet_replica.cc:330] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4: stopping tablet replica
I20260808 09:58:28.037312 4197 raft_consensus.cc:2258] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:28.037320 4196 raft_consensus.cc:2229] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:28.037310 4022 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d32a5387594333b46a8a79859eb2b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:28 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:39230
I20260808 09:58:28.037360 4196 raft_consensus.cc:2258] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:28.037408 4194 tablet_replica.cc:330] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772: stopping tablet replica
I20260808 09:58:28.037467 4194 raft_consensus.cc:2229] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:28.037499 4194 raft_consensus.cc:2258] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:28.037693 4196 ts_tablet_manager.cc:1905] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:28.037887 4194 ts_tablet_manager.cc:1905] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:28.037942 4197 ts_tablet_manager.cc:1905] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:28.039472 4196 ts_tablet_manager.cc:1918] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:58:28.039531 4196 log.cc:1196] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/wal/wals/e2d32a5387594333b46a8a79859eb2b9
I20260808 09:58:28.039561 4197 ts_tablet_manager.cc:1918] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:58:28.039577 4194 ts_tablet_manager.cc:1918] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:58:28.039609 4197 log.cc:1196] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/e2d32a5387594333b46a8a79859eb2b9
I20260808 09:58:28.039633 4194 log.cc:1196] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/e2d32a5387594333b46a8a79859eb2b9
I20260808 09:58:28.039769 4196 ts_tablet_manager.cc:1939] T e2d32a5387594333b46a8a79859eb2b9 P 6b1664c210b749a2bbd3b8c71fbb95c4: Deleting consensus metadata
I20260808 09:58:28.039819 4197 ts_tablet_manager.cc:1939] T e2d32a5387594333b46a8a79859eb2b9 P 014925260a3c442f8082c4206116b752: Deleting consensus metadata
I20260808 09:58:28.039880 4194 ts_tablet_manager.cc:1939] T e2d32a5387594333b46a8a79859eb2b9 P eeb327884fd94b2ea5d9d31b28e79772: Deleting consensus metadata
I20260808 09:58:28.040094 3385 catalog_manager.cc:4841] TS 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193:42475): tablet e2d32a5387594333b46a8a79859eb2b9 (table test-table [id=865e0c9e0c114185af513ab18fb515d6]) successfully deleted
I20260808 09:58:28.040285 3387 catalog_manager.cc:4841] TS 014925260a3c442f8082c4206116b752 (127.24.71.194:42137): tablet e2d32a5387594333b46a8a79859eb2b9 (table test-table [id=865e0c9e0c114185af513ab18fb515d6]) successfully deleted
I20260808 09:58:28.040354 3387 catalog_manager.cc:4841] TS eeb327884fd94b2ea5d9d31b28e79772 (127.24.71.195:42327): tablet e2d32a5387594333b46a8a79859eb2b9 (table test-table [id=865e0c9e0c114185af513ab18fb515d6]) successfully deleted
Aug 08 09:58:28 dist-test-slave-gw5c krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 09:58:28 dist-test-slave-gw5c krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:28 dist-test-slave-gw5c krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 09:58:28.076364 3476 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:28.069055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59612 (local address 127.24.71.254:37799)
0808 09:58:28.069112 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:28.069114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:28.069247 (+ 133us) server_negotiation.cc:407] Connection header received
0808 09:58:28.069309 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:28.069310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:28.069324 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:28.069403 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:28.070156 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.070989 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.072239 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.072550 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.072619 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.076294 (+ 3675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59612: BlockingRecv error: recv got EOF from 127.0.0.1:59612 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 09:58:28 dist-test-slave-gw5c krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM
I20260808 09:58:28.086947 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.077518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59622 (local address 127.24.71.254:37799)
0808 09:58:28.077562 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:28.077564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:28.077797 (+ 233us) server_negotiation.cc:407] Connection header received
0808 09:58:28.077860 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:28.077861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:28.077872 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:28.077934 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:28.078559 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.079347 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.080399 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.080704 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.080775 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.083695 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:28.083696 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:28.083697 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:28.083707 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:28.085562 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:28.085983 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:28.085985 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:28.085985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:28.086052 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:28.086339 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:28.086340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:28.086341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:28.086497 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:28.086607 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:28.086749 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 09:58:28.086841 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 09:58:28.088963 3404 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59622:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:58:28.089159 3404 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:58:28.090715 4022 tablet_service.cc:1467] Processing CreateTablet for tablet 34e053b852ac4e64ab6bf9e317d8516d (DEFAULT_TABLE table=test-table [id=0f62c54e5667486fa457849c095053c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:28.090726 3825 tablet_service.cc:1467] Processing CreateTablet for tablet 34e053b852ac4e64ab6bf9e317d8516d (DEFAULT_TABLE table=test-table [id=0f62c54e5667486fa457849c095053c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:28.090898 3825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e053b852ac4e64ab6bf9e317d8516d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:28.090896 4022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e053b852ac4e64ab6bf9e317d8516d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:28.092307 4169 tablet_bootstrap.cc:492] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752: Bootstrap starting.
I20260808 09:58:28.092476 3609 tablet_service.cc:1467] Processing CreateTablet for tablet 34e053b852ac4e64ab6bf9e317d8516d (DEFAULT_TABLE table=test-table [id=0f62c54e5667486fa457849c095053c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:28.092604 3609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e053b852ac4e64ab6bf9e317d8516d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:28.092726 4169 tablet_bootstrap.cc:654] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:28.093998 4161 tablet_bootstrap.cc:492] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4: Bootstrap starting.
I20260808 09:58:28.094017 4160 tablet_bootstrap.cc:492] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772: Bootstrap starting.
I20260808 09:58:28.094427 4161 tablet_bootstrap.cc:654] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:28.094450 4160 tablet_bootstrap.cc:654] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:28.095016 4161 tablet_bootstrap.cc:492] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4: No bootstrap required, opened a new log
I20260808 09:58:28.095057 4161 ts_tablet_manager.cc:1397] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:28.095201 4161 raft_consensus.cc:348] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.095294 4161 raft_consensus.cc:374] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:28.095343 4161 raft_consensus.cc:729] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1664c210b749a2bbd3b8c71fbb95c4, State: Initialized, Role: FOLLOWER
I20260808 09:58:28.095618 4161 consensus_queue.cc:260] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.095774 4161 ts_tablet_manager.cc:1428] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:28.095820 4169 tablet_bootstrap.cc:492] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752: No bootstrap required, opened a new log
I20260808 09:58:28.095875 4169 ts_tablet_manager.cc:1397] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260808 09:58:28.096026 4169 raft_consensus.cc:348] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.096133 4169 raft_consensus.cc:374] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:28.096156 4169 raft_consensus.cc:729] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 014925260a3c442f8082c4206116b752, State: Initialized, Role: FOLLOWER
I20260808 09:58:28.096197 4169 consensus_queue.cc:260] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.096279 4169 ts_tablet_manager.cc:1428] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 09:58:28.096323 4160 tablet_bootstrap.cc:492] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772: No bootstrap required, opened a new log
I20260808 09:58:28.096370 4160 ts_tablet_manager.cc:1397] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:58:28.096580 4160 raft_consensus.cc:348] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.096657 4160 raft_consensus.cc:374] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:28.096685 4160 raft_consensus.cc:729] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeb327884fd94b2ea5d9d31b28e79772, State: Initialized, Role: FOLLOWER
I20260808 09:58:28.096724 4160 consensus_queue.cc:260] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.096818 4160 ts_tablet_manager.cc:1428] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:28.207077 4174 raft_consensus.cc:482] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:28.207186 4174 raft_consensus.cc:504] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.207367 4174 leader_election.cc:288] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193:42475), eeb327884fd94b2ea5d9d31b28e79772 (127.24.71.195:42327)
I20260808 09:58:28.207679 4047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34e053b852ac4e64ab6bf9e317d8516d" candidate_uuid: "014925260a3c442f8082c4206116b752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeb327884fd94b2ea5d9d31b28e79772" is_pre_election: true
I20260808 09:58:28.207690 3635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34e053b852ac4e64ab6bf9e317d8516d" candidate_uuid: "014925260a3c442f8082c4206116b752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" is_pre_election: true
I20260808 09:58:28.207791 3635 raft_consensus.cc:2454] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 014925260a3c442f8082c4206116b752 in term 0.
I20260808 09:58:28.207794 4047 raft_consensus.cc:2454] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 014925260a3c442f8082c4206116b752 in term 0.
I20260808 09:58:28.207991 3746 leader_election.cc:302] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 014925260a3c442f8082c4206116b752, 6b1664c210b749a2bbd3b8c71fbb95c4; no voters:
I20260808 09:58:28.208087 4174 raft_consensus.cc:2781] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:58:28.208155 4174 raft_consensus.cc:482] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:58:28.208181 4174 raft_consensus.cc:3037] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:28.208930 4174 raft_consensus.cc:504] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.209082 4174 leader_election.cc:288] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193:42475), eeb327884fd94b2ea5d9d31b28e79772 (127.24.71.195:42327)
I20260808 09:58:28.209215 3635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34e053b852ac4e64ab6bf9e317d8516d" candidate_uuid: "014925260a3c442f8082c4206116b752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4"
I20260808 09:58:28.209283 4047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34e053b852ac4e64ab6bf9e317d8516d" candidate_uuid: "014925260a3c442f8082c4206116b752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeb327884fd94b2ea5d9d31b28e79772"
I20260808 09:58:28.209323 3635 raft_consensus.cc:3037] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:28.209353 4047 raft_consensus.cc:3037] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:28.210134 4047 raft_consensus.cc:2454] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 014925260a3c442f8082c4206116b752 in term 1.
I20260808 09:58:28.210134 3635 raft_consensus.cc:2454] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 014925260a3c442f8082c4206116b752 in term 1.
I20260808 09:58:28.210325 3750 leader_election.cc:302] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 014925260a3c442f8082c4206116b752, eeb327884fd94b2ea5d9d31b28e79772; no voters:
I20260808 09:58:28.210433 4174 raft_consensus.cc:2781] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:28.210489 4174 raft_consensus.cc:686] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [term 1 LEADER]: Becoming Leader. State: Replica: 014925260a3c442f8082c4206116b752, State: Running, Role: LEADER
I20260808 09:58:28.210533 4174 consensus_queue.cc:237] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.211117 3404 catalog_manager.cc:5495] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 reported cstate change: term changed from 0 to 1, leader changed from <none> to 014925260a3c442f8082c4206116b752 (127.24.71.194). New cstate: current_term: 1 leader_uuid: "014925260a3c442f8082c4206116b752" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260808 09:58:28.216645 4159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.213984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42980 (local address 127.24.71.194:42137)
0808 09:58:28.214054 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:28.214056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:28.214063 (+ 7us) server_negotiation.cc:407] Connection header received
0808 09:58:28.214083 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:28.214084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:28.214093 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:28.214139 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:28.214297 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.214832 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.215856 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.216169 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.216265 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.216419 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:28.216458 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:28.216499 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:28.216537 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 09:58:28.216558 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 09:58:28.217417 4047 raft_consensus.cc:1261] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Refusing update from remote peer 014925260a3c442f8082c4206116b752: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:28.217429 3635 raft_consensus.cc:1261] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Refusing update from remote peer 014925260a3c442f8082c4206116b752: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:28.217634 4203 consensus_queue.cc:1035] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:28.217732 4174 consensus_queue.cc:1035] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:28.220492 3403 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:28.220571 3403 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:28.221180 3403 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11: Sending DeleteTablet for 3 replicas of tablet 34e053b852ac4e64ab6bf9e317d8516d
I20260808 09:58:28.221448 3609 tablet_service.cc:1514] Processing DeleteTablet for tablet 34e053b852ac4e64ab6bf9e317d8516d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:28 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:48662
I20260808 09:58:28.221490 4022 tablet_service.cc:1514] Processing DeleteTablet for tablet 34e053b852ac4e64ab6bf9e317d8516d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:28 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:39230
I20260808 09:58:28.221544 4196 tablet_replica.cc:330] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4: stopping tablet replica
I20260808 09:58:28.221598 4196 raft_consensus.cc:2229] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:28.221586 4194 tablet_replica.cc:330] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772: stopping tablet replica
I20260808 09:58:28.221652 4196 raft_consensus.cc:2258] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:28.221658 4194 raft_consensus.cc:2229] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:28.221711 4194 raft_consensus.cc:2258] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:28.221786 3825 tablet_service.cc:1514] Processing DeleteTablet for tablet 34e053b852ac4e64ab6bf9e317d8516d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:28 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:42956
I20260808 09:58:28.221810 3403 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59622:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 09:58:28.221928 4197 tablet_replica.cc:330] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752: stopping tablet replica
I20260808 09:58:28.221975 4197 raft_consensus.cc:2229] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [term 1 LEADER]: Raft consensus shutting down.
W20260808 09:58:28.221990 3403 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:58:28.222031 4197 raft_consensus.cc:2258] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:28.222020 4194 ts_tablet_manager.cc:1905] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:28.222498 4197 ts_tablet_manager.cc:1905] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:28.222878 4196 ts_tablet_manager.cc:1905] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:28.223165 3609 tablet_service.cc:1467] Processing CreateTablet for tablet d7a9ec83967448adad921eaae444ddb6 (DEFAULT_TABLE table=test-table [id=c11802bc1dbd4f11a0fac3a7611862f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:28.223269 3609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7a9ec83967448adad921eaae444ddb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:28.223641 4022 tablet_service.cc:1467] Processing CreateTablet for tablet d7a9ec83967448adad921eaae444ddb6 (DEFAULT_TABLE table=test-table [id=c11802bc1dbd4f11a0fac3a7611862f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:28.223768 4022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7a9ec83967448adad921eaae444ddb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:28.224262 4197 ts_tablet_manager.cc:1918] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:28.224319 4197 log.cc:1196] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/34e053b852ac4e64ab6bf9e317d8516d
I20260808 09:58:28.224392 4196 ts_tablet_manager.cc:1918] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:28.224445 4196 log.cc:1196] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/wal/wals/34e053b852ac4e64ab6bf9e317d8516d
I20260808 09:58:28.224565 4197 ts_tablet_manager.cc:1939] T 34e053b852ac4e64ab6bf9e317d8516d P 014925260a3c442f8082c4206116b752: Deleting consensus metadata
I20260808 09:58:28.224653 4196 ts_tablet_manager.cc:1939] T 34e053b852ac4e64ab6bf9e317d8516d P 6b1664c210b749a2bbd3b8c71fbb95c4: Deleting consensus metadata
I20260808 09:58:28.225008 4160 tablet_bootstrap.cc:492] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772: Bootstrap starting.
I20260808 09:58:28.225039 3385 catalog_manager.cc:4841] TS 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193:42475): tablet 34e053b852ac4e64ab6bf9e317d8516d (table test-table [id=0f62c54e5667486fa457849c095053c5]) successfully deleted
I20260808 09:58:28.225329 4160 tablet_bootstrap.cc:654] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:28.225888 4160 tablet_bootstrap.cc:492] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772: No bootstrap required, opened a new log
I20260808 09:58:28.225931 4160 ts_tablet_manager.cc:1397] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:28.226051 4160 raft_consensus.cc:348] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.226082 4161 tablet_bootstrap.cc:492] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4: Bootstrap starting.
I20260808 09:58:28.226132 4160 raft_consensus.cc:374] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:28.226161 4160 raft_consensus.cc:729] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeb327884fd94b2ea5d9d31b28e79772, State: Initialized, Role: FOLLOWER
I20260808 09:58:28.226215 4160 consensus_queue.cc:260] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.226329 4160 ts_tablet_manager.cc:1428] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:28.226394 3825 tablet_service.cc:1467] Processing CreateTablet for tablet d7a9ec83967448adad921eaae444ddb6 (DEFAULT_TABLE table=test-table [id=c11802bc1dbd4f11a0fac3a7611862f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:28.226470 4161 tablet_bootstrap.cc:654] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:28.226500 3825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7a9ec83967448adad921eaae444ddb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:28.227056 4161 tablet_bootstrap.cc:492] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4: No bootstrap required, opened a new log
I20260808 09:58:28.227119 4161 ts_tablet_manager.cc:1397] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:28.227262 4161 raft_consensus.cc:348] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.227335 4161 raft_consensus.cc:374] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:28.227367 4161 raft_consensus.cc:729] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1664c210b749a2bbd3b8c71fbb95c4, State: Initialized, Role: FOLLOWER
I20260808 09:58:28.227459 4169 tablet_bootstrap.cc:492] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752: Bootstrap starting.
I20260808 09:58:28.227471 4161 consensus_queue.cc:260] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.227525 3387 catalog_manager.cc:4841] TS 014925260a3c442f8082c4206116b752 (127.24.71.194:42137): tablet 34e053b852ac4e64ab6bf9e317d8516d (table test-table [id=0f62c54e5667486fa457849c095053c5]) successfully deleted
I20260808 09:58:28.227564 4161 ts_tablet_manager.cc:1428] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:28.227794 4169 tablet_bootstrap.cc:654] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:28.223768 4194 ts_tablet_manager.cc:1918] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:28.228410 4194 log.cc:1196] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/34e053b852ac4e64ab6bf9e317d8516d
I20260808 09:58:28.228431 4169 tablet_bootstrap.cc:492] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752: No bootstrap required, opened a new log
I20260808 09:58:28.228487 4169 ts_tablet_manager.cc:1397] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:28.228590 4169 raft_consensus.cc:348] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.228643 4194 ts_tablet_manager.cc:1939] T 34e053b852ac4e64ab6bf9e317d8516d P eeb327884fd94b2ea5d9d31b28e79772: Deleting consensus metadata
I20260808 09:58:28.228672 4169 raft_consensus.cc:374] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:28.228698 4169 raft_consensus.cc:729] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 014925260a3c442f8082c4206116b752, State: Initialized, Role: FOLLOWER
I20260808 09:58:28.228749 4169 consensus_queue.cc:260] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.228845 4169 ts_tablet_manager.cc:1428] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 09:58:28.228942 3387 catalog_manager.cc:4841] TS eeb327884fd94b2ea5d9d31b28e79772 (127.24.71.195:42327): tablet 34e053b852ac4e64ab6bf9e317d8516d (table test-table [id=0f62c54e5667486fa457849c095053c5]) successfully deleted
I20260808 09:58:28.275079 4168 raft_consensus.cc:482] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:28.275209 4168 raft_consensus.cc:504] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.275651 4168 leader_election.cc:288] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 014925260a3c442f8082c4206116b752 (127.24.71.194:42137), eeb327884fd94b2ea5d9d31b28e79772 (127.24.71.195:42327)
I20260808 09:58:28.279148 4159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.275979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:57169 (local address 127.24.71.194:42137)
0808 09:58:28.276065 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:28.276068 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:28.276155 (+ 87us) server_negotiation.cc:407] Connection header received
0808 09:58:28.276265 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:28.276266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:28.276277 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:28.276351 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:28.276640 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.277141 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.278342 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.278718 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.278786 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.278817 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:28.279008 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 09:58:28.279053 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 09:58:28.279165 4154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.276231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:39183 (local address 127.24.71.195:42327)
0808 09:58:28.276286 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:28.276289 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:28.276333 (+ 44us) server_negotiation.cc:407] Connection header received
0808 09:58:28.276432 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:28.276433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:28.276444 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:28.276496 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:28.276707 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.277167 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.278374 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.278733 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.278848 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.278857 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:28.279051 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 09:58:28.279095 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 09:58:28.279186 4271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.275890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:42137 (local address 127.24.71.193:57169)
0808 09:58:28.276061 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:28.276075 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:28.276172 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:28.276473 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:28.276474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:28.276477 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:28.276553 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:28.276555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.277252 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.277254 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:28.278241 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:28.278244 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.278835 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.278837 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:28.278911 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.278915 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:58:28.278979 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 09:58:28.279048 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":1,"thread_start_us":98,"threads_started":1}
I20260808 09:58:28.279258 4273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.276133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:42327 (local address 127.24.71.193:39183)
0808 09:58:28.276263 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:28.276275 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:28.276357 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:28.276510 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:28.276511 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:28.276513 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:28.276628 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:28.276630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.277283 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.277284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:28.278246 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:28.278249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.278858 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.278859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:28.278931 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.278935 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 09:58:28.279031 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 09:58:28.279073 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":4,"thread_start_us":130,"threads_started":1}
I20260808 09:58:28.279808 4047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7a9ec83967448adad921eaae444ddb6" candidate_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeb327884fd94b2ea5d9d31b28e79772" is_pre_election: true
I20260808 09:58:28.279870 3850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7a9ec83967448adad921eaae444ddb6" candidate_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "014925260a3c442f8082c4206116b752" is_pre_election: true
I20260808 09:58:28.279954 4047 raft_consensus.cc:2454] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1664c210b749a2bbd3b8c71fbb95c4 in term 0.
I20260808 09:58:28.279991 3850 raft_consensus.cc:2454] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1664c210b749a2bbd3b8c71fbb95c4 in term 0.
I20260808 09:58:28.280161 3541 leader_election.cc:302] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1664c210b749a2bbd3b8c71fbb95c4, eeb327884fd94b2ea5d9d31b28e79772; no voters:
I20260808 09:58:28.280359 4168 raft_consensus.cc:2781] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:58:28.280418 4168 raft_consensus.cc:482] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:58:28.280441 4168 raft_consensus.cc:3037] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:28.281301 4168 raft_consensus.cc:504] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.281420 4168 leader_election.cc:288] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [CANDIDATE]: Term 1 election: Requested vote from peers 014925260a3c442f8082c4206116b752 (127.24.71.194:42137), eeb327884fd94b2ea5d9d31b28e79772 (127.24.71.195:42327)
I20260808 09:58:28.281594 3850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7a9ec83967448adad921eaae444ddb6" candidate_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "014925260a3c442f8082c4206116b752"
I20260808 09:58:28.281679 3850 raft_consensus.cc:3037] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:28.281641 4047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7a9ec83967448adad921eaae444ddb6" candidate_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeb327884fd94b2ea5d9d31b28e79772"
I20260808 09:58:28.281713 4047 raft_consensus.cc:3037] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:28.282498 4047 raft_consensus.cc:2454] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1664c210b749a2bbd3b8c71fbb95c4 in term 1.
I20260808 09:58:28.282498 3850 raft_consensus.cc:2454] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1664c210b749a2bbd3b8c71fbb95c4 in term 1.
I20260808 09:58:28.282682 3541 leader_election.cc:302] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b1664c210b749a2bbd3b8c71fbb95c4, eeb327884fd94b2ea5d9d31b28e79772; no voters:
I20260808 09:58:28.282796 4168 raft_consensus.cc:2781] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:28.282976 4168 raft_consensus.cc:686] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 LEADER]: Becoming Leader. State: Replica: 6b1664c210b749a2bbd3b8c71fbb95c4, State: Running, Role: LEADER
I20260808 09:58:28.283068 4168 consensus_queue.cc:237] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } }
I20260808 09:58:28.283854 3404 catalog_manager.cc:5495] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193). New cstate: current_term: 1 leader_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1664c210b749a2bbd3b8c71fbb95c4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260808 09:58:28.292415 4155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.289852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48676 (local address 127.24.71.193:42475)
0808 09:58:28.289909 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:28.289912 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:28.289956 (+ 44us) server_negotiation.cc:407] Connection header received
0808 09:58:28.290061 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:28.290062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:28.290087 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:28.290181 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:28.290344 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.290815 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.291621 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.291831 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.291909 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.292053 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:28.292172 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:28.292258 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:28.292309 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 09:58:28.292329 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 09:58:28.297282 4154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.294872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:54011 (local address 127.24.71.195:42327)
0808 09:58:28.294937 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:28.294939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:28.295055 (+ 116us) server_negotiation.cc:407] Connection header received
0808 09:58:28.295113 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:28.295114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:28.295122 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:28.295162 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:28.295286 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.295850 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.296628 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.296820 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.296873 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.297077 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:28.297101 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:28.297139 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:28.297213 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 09:58:28.297230 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 09:58:28.297303 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.294806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:42327 (local address 127.24.71.193:54011)
0808 09:58:28.294981 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:28.294993 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:28.295059 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:28.295178 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:28.295178 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:28.295179 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 09:58:28.295229 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:28.295230 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.295914 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.295915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:28.296549 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:28.296551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.296909 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.296910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:28.296986 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.297000 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 09:58:28.297153 (+ 153us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 09:58:28.297155 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 09:58:28.297200 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 09:58:28.297237 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":96,"threads_started":1}
I20260808 09:58:28.299624 4047 raft_consensus.cc:1261] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Refusing update from remote peer 6b1664c210b749a2bbd3b8c71fbb95c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:28.299641 3850 raft_consensus.cc:1261] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Refusing update from remote peer 6b1664c210b749a2bbd3b8c71fbb95c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:28.299943 4275 consensus_queue.cc:1035] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "014925260a3c442f8082c4206116b752" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:28.300084 4168 consensus_queue.cc:1035] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeb327884fd94b2ea5d9d31b28e79772" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:28.307156 4122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.304813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:42475 (local address 127.24.71.195:54853)
0808 09:58:28.304856 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:28.304868 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:28.304911 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:28.305150 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:28.305151 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:28.305153 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 09:58:28.305198 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:28.305199 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.305827 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.305828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:28.306375 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:28.306376 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.306749 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.306750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:28.306805 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.306809 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 09:58:28.306990 (+ 181us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 09:58:28.306993 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:28.307046 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 09:58:28.307092 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 09:58:28.307143 4155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:28.304989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:54853 (local address 127.24.71.193:42475)
0808 09:58:28.305027 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:28.305029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:28.305036 (+ 7us) server_negotiation.cc:407] Connection header received
0808 09:58:28.305054 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:28.305055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:28.305064 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:28.305133 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:28.305248 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.305725 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.306462 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:28.306667 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:28.306741 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:28.306886 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:28.306918 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:28.306989 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:28.307052 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 09:58:28.307072 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 09:58:28.314039 3402 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:28.314131 3402 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:28.314781 3402 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c4a23bbbe586442abbfd8d42a4706f11: Sending DeleteTablet for 3 replicas of tablet d7a9ec83967448adad921eaae444ddb6
I20260808 09:58:28.315033 3825 tablet_service.cc:1514] Processing DeleteTablet for tablet d7a9ec83967448adad921eaae444ddb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:28 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:42956
I20260808 09:58:28.315055 4022 tablet_service.cc:1514] Processing DeleteTablet for tablet d7a9ec83967448adad921eaae444ddb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:28 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:39230
I20260808 09:58:28.315181 3609 tablet_service.cc:1514] Processing DeleteTablet for tablet d7a9ec83967448adad921eaae444ddb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:28 UTC) from {username='oryx', principal='oryx/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:48662
I20260808 09:58:28.315276 4197 tablet_replica.cc:330] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752: stopping tablet replica
I20260808 09:58:28.315291 4196 tablet_replica.cc:330] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4: stopping tablet replica
I20260808 09:58:28.315348 4197 raft_consensus.cc:2229] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:28.315347 4196 raft_consensus.cc:2229] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 09:58:28.315379 4197 raft_consensus.cc:2258] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:28.315459 4196 raft_consensus.cc:2258] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:28.315490 4194 tablet_replica.cc:330] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772: stopping tablet replica
I20260808 09:58:28.315546 4194 raft_consensus.cc:2229] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:28.315582 4194 raft_consensus.cc:2258] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:28.315719 4197 ts_tablet_manager.cc:1905] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:28.315753 4196 ts_tablet_manager.cc:1905] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:28.316061 4194 ts_tablet_manager.cc:1905] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:28.317363 4196 ts_tablet_manager.cc:1918] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:58:28.317420 4196 log.cc:1196] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-0/wal/wals/d7a9ec83967448adad921eaae444ddb6
I20260808 09:58:28.317476 4197 ts_tablet_manager.cc:1918] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:58:28.317534 4197 log.cc:1196] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/d7a9ec83967448adad921eaae444ddb6
I20260808 09:58:28.317607 4194 ts_tablet_manager.cc:1918] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 09:58:28.317657 4194 log.cc:1196] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/d7a9ec83967448adad921eaae444ddb6
I20260808 09:58:28.317656 4196 ts_tablet_manager.cc:1939] T d7a9ec83967448adad921eaae444ddb6 P 6b1664c210b749a2bbd3b8c71fbb95c4: Deleting consensus metadata
I20260808 09:58:28.317765 4197 ts_tablet_manager.cc:1939] T d7a9ec83967448adad921eaae444ddb6 P 014925260a3c442f8082c4206116b752: Deleting consensus metadata
I20260808 09:58:28.317868 4194 ts_tablet_manager.cc:1939] T d7a9ec83967448adad921eaae444ddb6 P eeb327884fd94b2ea5d9d31b28e79772: Deleting consensus metadata
I20260808 09:58:28.318002 3385 catalog_manager.cc:4841] TS 6b1664c210b749a2bbd3b8c71fbb95c4 (127.24.71.193:42475): tablet d7a9ec83967448adad921eaae444ddb6 (table test-table [id=c11802bc1dbd4f11a0fac3a7611862f7]) successfully deleted
I20260808 09:58:28.318194 3387 catalog_manager.cc:4841] TS 014925260a3c442f8082c4206116b752 (127.24.71.194:42137): tablet d7a9ec83967448adad921eaae444ddb6 (table test-table [id=c11802bc1dbd4f11a0fac3a7611862f7]) successfully deleted
I20260808 09:58:28.318449 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 3513
I20260808 09:58:28.327138 3387 catalog_manager.cc:4841] TS eeb327884fd94b2ea5d9d31b28e79772 (127.24.71.195:42327): tablet d7a9ec83967448adad921eaae444ddb6 (table test-table [id=c11802bc1dbd4f11a0fac3a7611862f7]) successfully deleted
I20260808 09:58:28.333438 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 3724
I20260808 09:58:28.344456 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 3927
I20260808 09:58:28.356568 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 3361
2026-08-08T09:58:28Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2858 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:58:28 dist-test-slave-gw5c krb5kdc[4287](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:58:28 dist-test-slave-gw5c krb5kdc[4287](info): set up 2 sockets
Aug 08 09:58:28 dist-test-slave-gw5c krb5kdc[4287](info): commencing operation
krb5kdc: starting...
W20260808 09:58:29.613390 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:58:29 dist-test-slave-gw5c krb5kdc[4287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:58:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:58:29.736552 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:43819
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:43819
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:29.819855 4303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:29.820115 4303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:29.820159 4303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:29.821326 4303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:29.821396 4303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:29.821424 4303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:29.821455 4303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:29.821480 4303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:29.822958 4303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:43819
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:43819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:29.823240 4303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:29.823539 4303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:29.828318 4309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:29.828347 4314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:29.828734 4303 server_base.cc:1034] running on GCE node
W20260808 09:58:29.828420 4310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:29.829118 4303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:29.829483 4303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:29.830662 4303 hybrid_clock.cc:648] HybridClock initialized: now 1786183109830645 us; error 43 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T09:58:29Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1472 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:58:29 dist-test-slave-gw5c krb5kdc[4323](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:58:29 dist-test-slave-gw5c krb5kdc[4323](info): set up 2 sockets
Aug 08 09:58:29 dist-test-slave-gw5c krb5kdc[4323](info): commencing operation
krb5kdc: starting...
W20260808 09:58:31.093376 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:58:31 dist-test-slave-gw5c krb5kdc[4323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:58:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:58:31.221735 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:43131
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:43131
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:31.308323 4339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:31.308585 4339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:31.308629 4339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:31.309769 4339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:31.309852 4339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:31.309885 4339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:31.309919 4339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:31.309943 4339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:31.311481 4339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:43131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:43131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:31.311782 4339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:31.312036 4339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:31.316912 4351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:31.316915 4344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:31.317152 4339 server_base.cc:1034] running on GCE node
W20260808 09:58:31.317148 4345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:31.317492 4339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:31.317790 4339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:31.318964 4339 hybrid_clock.cc:648] HybridClock initialized: now 1786183111318953 us; error 47 us; skew 500 ppm
Aug 08 09:58:31 dist-test-slave-gw5c krb5kdc[4323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183111, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:31.321533 4339 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:58:31.322026 4339 webserver.cc:460] Webserver started at http://127.24.71.254:42611/ using document root <none> and password file <none>
I20260808 09:58:31.322260 4339 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:31.322333 4339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:31.322499 4339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:31.323666 4339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "5a7a37ca6a20470d982a1c6d69d1c24b"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "ae4f28e5ed5789f42a28fe1c2d27b498"
server_key_iv: "cbf1e280db22ab1e1822f06dc6e3cfae"
server_key_version: "encryptionkey@0"
I20260808 09:58:31.324056 4339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "5a7a37ca6a20470d982a1c6d69d1c24b"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "ae4f28e5ed5789f42a28fe1c2d27b498"
server_key_iv: "cbf1e280db22ab1e1822f06dc6e3cfae"
server_key_version: "encryptionkey@0"
I20260808 09:58:31.325479 4339 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 09:58:31.326272 4362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:31.326489 4339 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:31.326606 4339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "5a7a37ca6a20470d982a1c6d69d1c24b"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "ae4f28e5ed5789f42a28fe1c2d27b498"
server_key_iv: "cbf1e280db22ab1e1822f06dc6e3cfae"
server_key_version: "encryptionkey@0"
I20260808 09:58:31.326685 4339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:31.344180 4339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:31.346299 4339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:31.346486 4339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:31.350831 4339 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:43131
I20260808 09:58:31.350871 4430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:43131 every 8 connection(s)
I20260808 09:58:31.351267 4339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:31.352273 4431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:31.354602 4431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b: Bootstrap starting.
I20260808 09:58:31.355171 4431 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:31.355504 4431 log.cc:824] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:31.356172 4431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b: No bootstrap required, opened a new log
I20260808 09:58:31.357465 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 4339
I20260808 09:58:31.357574 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:31.357775 24863 external_mini_cluster.cc:1428] Setting key 846502cfc77da3de0002d436070d9eb2
I20260808 09:58:31.358155 4431 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43131 } }
I20260808 09:58:31.358337 4431 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:31.358424 4431 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7a37ca6a20470d982a1c6d69d1c24b, State: Initialized, Role: FOLLOWER
I20260808 09:58:31.358608 4431 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43131 } }
I20260808 09:58:31.358705 4431 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:31.358749 4431 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:31.358799 4431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:31.359899 4431 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43131 } }
I20260808 09:58:31.360011 4431 leader_election.cc:302] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a7a37ca6a20470d982a1c6d69d1c24b; no voters:
I20260808 09:58:31.360173 4431 leader_election.cc:288] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:31.360248 4437 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:31.360414 4431 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:31.360447 4437 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 1 LEADER]: Becoming Leader. State: Replica: 5a7a37ca6a20470d982a1c6d69d1c24b, State: Running, Role: LEADER
I20260808 09:58:31.360680 4437 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43131 } }
I20260808 09:58:31.361043 4437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a7a37ca6a20470d982a1c6d69d1c24b. Latest consensus state: current_term: 1 leader_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43131 } } }
I20260808 09:58:31.361294 4437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:31.361717 4450 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:31.361210 4442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43131 } } }
I20260808 09:58:31.362232 4442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:31.362447 4450 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:31.364126 4450 catalog_manager.cc:1347] Generated new cluster ID: 2961ba8184534da580eab8cc6fe459ef
I20260808 09:58:31.364182 4450 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 09:58:31 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:31.368964 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:31.358330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57700 (local address 127.24.71.254:43131)
0808 09:58:31.358576 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:31.358585 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:31.358616 (+ 31us) server_negotiation.cc:407] Connection header received
0808 09:58:31.358730 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:31.358736 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:31.358795 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:31.358939 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:31.359621 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.361079 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.362269 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.362751 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.362874 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:31.365548 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:31.365552 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:31.365552 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:31.365570 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:31.367273 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:31.367696 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:31.367699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:31.367700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:31.367806 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:31.368026 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:31.368027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:31.368027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:31.368352 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:31.368569 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:31.368653 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 09:58:31.368803 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":93,"threads_started":1}
I20260808 09:58:31.387789 4450 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:31.388414 4450 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:31.392623 4450 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b: Generated new TSK 0
I20260808 09:58:31.392819 4450 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 09:58:31.430673 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43131
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:31.526129 4463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:31.526355 4463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:31.526381 4463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:31.527629 4463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:31.527676 4463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:31.527725 4463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:31.529253 4463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:31.529515 4463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:31.529769 4463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:31.534965 4474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:31.535015 4469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:31.535039 4471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:31.535252 4463 server_base.cc:1034] running on GCE node
I20260808 09:58:31.535609 4463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:31.535884 4463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:31.537045 4463 hybrid_clock.cc:648] HybridClock initialized: now 1786183111537032 us; error 28 us; skew 500 ppm
Aug 08 09:58:31 dist-test-slave-gw5c krb5kdc[4323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183111, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:31.539829 4463 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 09:58:31.540306 4463 webserver.cc:460] Webserver started at http://127.24.71.193:37775/ using document root <none> and password file <none>
I20260808 09:58:31.540547 4463 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:31.540620 4463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:31.540791 4463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:31.541872 4463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "2200f80b21604886947f40722dcda7c0"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "3082bbba425994e809f19366a7367222"
server_key_iv: "80c1e085997617b49cc4741cb456f4f3"
server_key_version: "encryptionkey@0"
I20260808 09:58:31.542264 4463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "2200f80b21604886947f40722dcda7c0"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "3082bbba425994e809f19366a7367222"
server_key_iv: "80c1e085997617b49cc4741cb456f4f3"
server_key_version: "encryptionkey@0"
I20260808 09:58:31.543784 4463 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 09:58:31.544672 4486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:31.544899 4463 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:31.545014 4463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "2200f80b21604886947f40722dcda7c0"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "3082bbba425994e809f19366a7367222"
server_key_iv: "80c1e085997617b49cc4741cb456f4f3"
server_key_version: "encryptionkey@0"
I20260808 09:58:31.545094 4463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:31.551630 4463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:31.553918 4463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:31.554085 4463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:31.554316 4463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:31.554631 4463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:31.554688 4463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:31.554730 4463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:31.554757 4463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:31.560649 4463 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:34429
I20260808 09:58:31.560730 4656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:34429 every 8 connection(s)
I20260808 09:58:31.561070 4463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 09:58:31.567231 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 4463
I20260808 09:58:31.567348 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
Aug 08 09:58:31 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183111, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:31.567569 24863 external_mini_cluster.cc:1428] Setting key 1aa891906873bec223dbb94c8d1c5808
I20260808 09:58:31.571272 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:31.561905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:42579 (local address 127.24.71.254:43131)
0808 09:58:31.561953 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:31.561955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:31.562199 (+ 244us) server_negotiation.cc:407] Connection header received
0808 09:58:31.562765 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:31.562767 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:31.562784 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:31.562840 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:31.563952 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.564478 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.565501 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.565711 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.565802 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:31.568025 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:31.568026 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:31.568027 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:31.568037 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:31.569657 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:31.570188 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:31.570190 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:31.570190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:31.570268 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:31.570620 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:31.570621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:31.570621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:31.570728 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:31.570781 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:31.571131 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 09:58:31.571206 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 09:58:31.571643 4659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:31.561863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:42579)
0808 09:58:31.562052 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:31.562089 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:31.562640 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:31.562914 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:31.562918 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:31.563629 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:31.563836 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:31.563842 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.564586 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.564587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:31.565399 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:31.565402 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.565821 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.565822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:31.565951 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:31.566470 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:31.566478 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:31.567940 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:31.569763 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:31.569770 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:31.569772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:31.570068 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:31.570350 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:31.570351 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:31.570352 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:31.570549 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:31.570796 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:31.570803 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:31.570984 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 09:58:31.571110 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 09:58:31.571303 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":92,"threads_started":1}
I20260808 09:58:31.572240 4657 heartbeater.cc:347] Connected to a master server at 127.24.71.254:43131
I20260808 09:58:31.572364 4657 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:31.572546 4657 heartbeater.cc:511] Master 127.24.71.254:43131 requested a full tablet report, sending...
I20260808 09:58:31.573091 4386 ts_manager.cc:194] Registered new tserver with Master: 2200f80b21604886947f40722dcda7c0 (127.24.71.193:34429)
I20260808 09:58:31.573735 4386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:42579
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 09:58:31.594746 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43131
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:31.678442 4663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:31.678661 4663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:31.678684 4663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:31.679922 4663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:31.679975 4663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:31.680003 4663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:31.681504 4663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:31.681780 4663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:31.682027 4663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:31.687081 4679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:31.687182 4675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:31.687106 4677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:31.687600 4663 server_base.cc:1034] running on GCE node
I20260808 09:58:31.687796 4663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:31.688001 4663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:31.689144 4663 hybrid_clock.cc:648] HybridClock initialized: now 1786183111689133 us; error 27 us; skew 500 ppm
Aug 08 09:58:31 dist-test-slave-gw5c krb5kdc[4323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183111, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:31.691709 4663 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 09:58:31.692157 4663 webserver.cc:460] Webserver started at http://127.24.71.194:37443/ using document root <none> and password file <none>
I20260808 09:58:31.692351 4663 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:31.692392 4663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:31.692509 4663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:31.693555 4663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "9206aa143e7e4e86a8493f5700958c38"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "549b8d5e7a5969998669dd3a37927a82"
server_key_iv: "3f359597de2913b502f510966a8c2417"
server_key_version: "encryptionkey@0"
I20260808 09:58:31.693876 4663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "9206aa143e7e4e86a8493f5700958c38"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "549b8d5e7a5969998669dd3a37927a82"
server_key_iv: "3f359597de2913b502f510966a8c2417"
server_key_version: "encryptionkey@0"
I20260808 09:58:31.695209 4663 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 09:58:31.696020 4687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:31.696223 4663 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 09:58:31.696322 4663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "9206aa143e7e4e86a8493f5700958c38"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "549b8d5e7a5969998669dd3a37927a82"
server_key_iv: "3f359597de2913b502f510966a8c2417"
server_key_version: "encryptionkey@0"
I20260808 09:58:31.696384 4663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:31.726768 4663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:31.728845 4663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:31.729018 4663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:31.729305 4663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:31.729637 4663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:31.729676 4663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:31.729698 4663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:31.729712 4663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:31.735839 4663 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:42385
I20260808 09:58:31.735919 4862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:42385 every 8 connection(s)
I20260808 09:58:31.736261 4663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:58:31.741008 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 4663
I20260808 09:58:31.741139 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:58:31.741370 24863 external_mini_cluster.cc:1428] Setting key 7eb1a774507343b3ac43f7101db850a8
Aug 08 09:58:31 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183111, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:31.747112 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:31.737159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:40613 (local address 127.24.71.254:43131)
0808 09:58:31.737222 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:31.737224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:31.737435 (+ 211us) server_negotiation.cc:407] Connection header received
0808 09:58:31.737911 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:31.737913 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:31.737922 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:31.737985 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:31.738939 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.739582 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.740613 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.740813 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.740870 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:31.743577 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:31.743579 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:31.743579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:31.743588 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:31.745476 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:31.746023 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:31.746024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:31.746024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:31.746081 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:31.746362 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:31.746363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:31.746363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:31.746470 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:31.746520 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:31.746905 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 09:58:31.746977 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 09:58:31.747380 4866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:31.737121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:40613)
0808 09:58:31.737286 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:31.737330 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:31.737828 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:31.738038 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:31.738041 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:31.738637 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:31.738837 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:31.738842 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.739670 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.739671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:31.740498 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:31.740501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.740903 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.740904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:31.741068 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:31.741727 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:31.741736 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:31.743477 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:31.745580 (+ 2103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:31.745588 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:31.745590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:31.745943 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:31.746148 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:31.746149 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:31.746149 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:31.746299 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:31.746534 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:31.746540 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:31.746726 (+ 186us) client_negotiation.cc:769] Sending connection context
0808 09:58:31.746883 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 09:58:31.747075 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":95,"threads_started":1}
I20260808 09:58:31.747967 4863 heartbeater.cc:347] Connected to a master server at 127.24.71.254:43131
I20260808 09:58:31.748095 4863 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:31.748317 4863 heartbeater.cc:511] Master 127.24.71.254:43131 requested a full tablet report, sending...
I20260808 09:58:31.748713 4386 ts_manager.cc:194] Registered new tserver with Master: 9206aa143e7e4e86a8493f5700958c38 (127.24.71.194:42385)
I20260808 09:58:31.749158 4386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:40613
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 09:58:31.770056 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43131
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:31.853252 4870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:31.853494 4870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:31.853535 4870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:31.854741 4870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:31.854811 4870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:31.854858 4870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:31.856400 4870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:31.856669 4870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:31.856909 4870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:31.862073 4876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:31.862151 4875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:31.862074 4878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:31.862634 4870 server_base.cc:1034] running on GCE node
I20260808 09:58:31.862839 4870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:31.863035 4870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:31.864169 4870 hybrid_clock.cc:648] HybridClock initialized: now 1786183111864149 us; error 41 us; skew 500 ppm
Aug 08 09:58:31 dist-test-slave-gw5c krb5kdc[4323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183111, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:31.866808 4870 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 09:58:31.867229 4870 webserver.cc:460] Webserver started at http://127.24.71.195:33093/ using document root <none> and password file <none>
I20260808 09:58:31.867512 4870 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:31.867561 4870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:31.867713 4870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:31.868813 4870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "a81b567ad267487ab50137e3abdf0fa8"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "8d7105c5e95aaa99cfc21933457ce74e"
server_key_iv: "9ad380cdea3125c5836bc44b071c1b40"
server_key_version: "encryptionkey@0"
I20260808 09:58:31.869220 4870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "a81b567ad267487ab50137e3abdf0fa8"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "8d7105c5e95aaa99cfc21933457ce74e"
server_key_iv: "9ad380cdea3125c5836bc44b071c1b40"
server_key_version: "encryptionkey@0"
I20260808 09:58:31.870559 4870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 09:58:31.871294 4887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:31.871515 4870 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:58:31.871619 4870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "a81b567ad267487ab50137e3abdf0fa8"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "8d7105c5e95aaa99cfc21933457ce74e"
server_key_iv: "9ad380cdea3125c5836bc44b071c1b40"
server_key_version: "encryptionkey@0"
I20260808 09:58:31.871701 4870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:31.882936 4870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:31.885001 4870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:31.885169 4870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:31.885411 4870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:31.885730 4870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:31.885787 4870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:31.885833 4870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:31.885859 4870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:31.891770 4870 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:37029
I20260808 09:58:31.891831 5050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:37029 every 8 connection(s)
I20260808 09:58:31.892145 4870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:58:31.895249 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 4870
I20260808 09:58:31.895358 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:58:31.895581 24863 external_mini_cluster.cc:1428] Setting key a75b2fefc37080b3e5e833196f56cd64
Aug 08 09:58:31 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183111, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:31.901716 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:31.892871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:41365 (local address 127.24.71.254:43131)
0808 09:58:31.892925 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:31.892927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:31.893139 (+ 212us) server_negotiation.cc:407] Connection header received
0808 09:58:31.893657 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:31.893658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:31.893668 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:31.893722 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:31.894655 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.895144 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.896634 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.896830 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.896885 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:31.898921 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:31.898922 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:31.898922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:31.898929 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:31.900495 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:31.900867 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:31.900868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:31.900868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:31.900921 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:31.901127 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:31.901127 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:31.901128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:31.901227 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:31.901277 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:31.901586 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 09:58:31.901650 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 09:58:31.901881 5057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:31.892881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:41365)
0808 09:58:31.893027 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:31.893061 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:31.893551 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:31.893777 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:31.893780 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:31.894361 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:31.894549 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:31.894554 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.895244 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.895245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:31.896555 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:31.896558 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:31.896902 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:31.896903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:31.897002 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:31.897454 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:31.897462 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:31.898839 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:31.900567 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:31.900573 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:31.900575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:31.900793 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:31.900977 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:31.900977 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:31.900978 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:31.901071 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:31.901319 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:31.901326 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:31.901462 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 09:58:31.901558 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 09:58:31.901679 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":82,"threads_started":1}
I20260808 09:58:31.902387 5051 heartbeater.cc:347] Connected to a master server at 127.24.71.254:43131
I20260808 09:58:31.902474 5051 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:31.902609 5051 heartbeater.cc:511] Master 127.24.71.254:43131 requested a full tablet report, sending...
I20260808 09:58:31.902930 4386 ts_manager.cc:194] Registered new tserver with Master: a81b567ad267487ab50137e3abdf0fa8 (127.24.71.195:37029)
I20260808 09:58:31.903326 4386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:41365
I20260808 09:58:31.907172 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab.
Entry for principal oryx/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab.
WARNING: no policy specified for oryx/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab.
Entry for principal oryx/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab.
WARNING: no policy specified for oryx/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab.
Entry for principal oryx/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab.
I20260808 09:58:31.985818 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 4463
I20260808 09:58:32.002024 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 4663
I20260808 09:58:32.017362 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 4870
I20260808 09:58:32.025588 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 4339
I20260808 09:58:32.037258 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:43131
--webserver_interface=127.24.71.254
--webserver_port=42611
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:43131
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:32.122043 5066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:32.122258 5066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:32.122282 5066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:32.123485 5066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:32.123528 5066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:32.123543 5066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:32.123555 5066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:32.123598 5066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:32.125090 5066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:43131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:43131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=42611
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:32.125357 5066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:32.125597 5066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:32.130777 5071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:32.130757 5072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:32.131043 5066 server_base.cc:1034] running on GCE node
W20260808 09:58:32.130757 5074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:32.131467 5066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:32.131816 5066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:32.133001 5066 hybrid_clock.cc:648] HybridClock initialized: now 1786183112132985 us; error 30 us; skew 500 ppm
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183112, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:32.138370 5066 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:58:32.138897 5066 webserver.cc:460] Webserver started at http://127.24.71.254:42611/ using document root <none> and password file <none>
I20260808 09:58:32.139178 5066 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:32.139271 5066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:32.140749 5066 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:32.141477 5085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:32.141682 5066 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:32.141816 5066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "5a7a37ca6a20470d982a1c6d69d1c24b"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "ae4f28e5ed5789f42a28fe1c2d27b498"
server_key_iv: "cbf1e280db22ab1e1822f06dc6e3cfae"
server_key_version: "encryptionkey@0"
I20260808 09:58:32.142208 5066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:32.168676 5066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:32.170711 5066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:32.170902 5066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:32.176241 5066 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:43131
I20260808 09:58:32.176270 5166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:43131 every 8 connection(s)
I20260808 09:58:32.176687 5066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:32.178238 5167 sys_catalog.cc:263] Verifying existing consensus state
I20260808 09:58:32.178953 5167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b: Bootstrap starting.
I20260808 09:58:32.183573 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 5066
I20260808 09:58:32.183878 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:34429
--local_ip_for_outbound_sockets=127.24.71.193
--tserver_master_addrs=127.24.71.254:43131
--webserver_port=37775
--webserver_interface=127.24.71.193
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.71.193
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 09:58:32.187870 5167 log.cc:824] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:32.189662 5167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 09:58:32.189976 5167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b: Bootstrap complete.
I20260808 09:58:32.192373 5167 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43131 } }
I20260808 09:58:32.192642 5167 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7a37ca6a20470d982a1c6d69d1c24b, State: Initialized, Role: FOLLOWER
I20260808 09:58:32.192835 5167 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43131 } }
I20260808 09:58:32.192924 5167 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:32.192981 5167 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:32.193034 5167 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 1 FOLLOWER]: Advancing to term 2
I20260808 09:58:32.194036 5167 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43131 } }
I20260808 09:58:32.194164 5167 leader_election.cc:302] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a7a37ca6a20470d982a1c6d69d1c24b; no voters:
I20260808 09:58:32.194361 5167 leader_election.cc:288] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 09:58:32.194437 5171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 2 FOLLOWER]: Leader election won for term 2
I20260808 09:58:32.194603 5171 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [term 2 LEADER]: Becoming Leader. State: Replica: 5a7a37ca6a20470d982a1c6d69d1c24b, State: Running, Role: LEADER
I20260808 09:58:32.194660 5167 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:32.194783 5171 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43131 } }
I20260808 09:58:32.195101 5171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a7a37ca6a20470d982a1c6d69d1c24b. Latest consensus state: current_term: 2 leader_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43131 } } }
I20260808 09:58:32.195174 5171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:32.195103 5173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7a37ca6a20470d982a1c6d69d1c24b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43131 } } }
I20260808 09:58:32.195276 5173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:32.195597 5180 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:32.196203 5180 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:32.196386 5180 catalog_manager.cc:1259] Loaded cluster ID: 2961ba8184534da580eab8cc6fe459ef
I20260808 09:58:32.196563 5180 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:32.197865 5180 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:32.198071 5180 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5a7a37ca6a20470d982a1c6d69d1c24b: Loaded TSK: 0
I20260808 09:58:32.198326 5180 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 09:58:32.269222 5169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:32.269500 5169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:32.269544 5169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:32.270771 5169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:32.270849 5169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:32.270897 5169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:32.272500 5169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.193.keytab
--principal=oryx/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:34429
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=37775
--tserver_master_addrs=127.24.71.254:43131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:32.272778 5169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:32.273021 5169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:32.280133 5206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:32.280164 5204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:32.280361 5202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:32.281181 5169 server_base.cc:1034] running on GCE node
I20260808 09:58:32.281411 5169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:32.281700 5169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:32.282887 5169 hybrid_clock.cc:648] HybridClock initialized: now 1786183112282873 us; error 29 us; skew 500 ppm
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183112, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:32.285946 5169 init.cc:377] Logged in from keytab as oryx/127.24.71.193@KRBTEST.COM (short username oryx)
I20260808 09:58:32.286481 5169 webserver.cc:460] Webserver started at http://127.24.71.193:37775/ using document root <none> and password file <none>
I20260808 09:58:32.286725 5169 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:32.286784 5169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:32.288331 5169 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:32.288993 5219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:32.289211 5169 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:32.289327 5169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "2200f80b21604886947f40722dcda7c0"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "3082bbba425994e809f19366a7367222"
server_key_iv: "80c1e085997617b49cc4741cb456f4f3"
server_key_version: "encryptionkey@0"
I20260808 09:58:32.289710 5169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:32.307090 5169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:32.309660 5169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:32.309880 5169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:32.310165 5169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:32.310503 5169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:32.310559 5169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:32.310602 5169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:32.310626 5169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:32.317198 5169 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:34429
I20260808 09:58:32.317246 5387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:34429 every 8 connection(s)
I20260808 09:58:32.317677 5169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 09:58:32.320179 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 5169
I20260808 09:58:32.320519 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:42385
--local_ip_for_outbound_sockets=127.24.71.194
--tserver_master_addrs=127.24.71.254:43131
--webserver_port=37443
--webserver_interface=127.24.71.194
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.71.194
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:32.327673 5392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:32.318519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:48231)
0808 09:58:32.318732 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:32.318787 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:32.319502 (+ 715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:32.319976 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:32.319981 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:32.320770 (+ 789us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:32.321040 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.321046 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.322654 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.322655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.323562 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.323564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.324173 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.324174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.324305 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.324897 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:32.324906 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:32.327428 (+ 2522us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":113,"threads_started":1}
W20260808 09:58:32.327735 5393 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:32.318686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:48231 (local address 127.24.71.254:43131)
0808 09:58:32.318872 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:32.318882 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:32.318914 (+ 32us) server_negotiation.cc:407] Connection header received
0808 09:58:32.319703 (+ 789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:32.319709 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:32.319756 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:32.319885 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:32.321190 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.322520 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.323656 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.324068 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.324198 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.327580 (+ 3382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:48231: BlockingRecv error: recv got EOF from 127.24.71.193:48231 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
W20260808 09:58:32.328020 5388 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:43131 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.71.254:43131: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:32.332980 5392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:32.328285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:60503)
0808 09:58:32.328417 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:32.328429 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:32.328505 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:32.328654 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:32.328655 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:32.328801 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:32.328857 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.328858 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.329501 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.329503 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.330008 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.330010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.330396 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.330397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.330471 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.330937 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:32.330947 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:32.332888 (+ 1941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114}
W20260808 09:58:32.333034 5393 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:32.328371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:60503 (local address 127.24.71.254:43131)
0808 09:58:32.328410 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:32.328412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:32.328488 (+ 76us) server_negotiation.cc:407] Connection header received
0808 09:58:32.328569 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:32.328569 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:32.328581 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:32.328653 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:32.328937 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.329420 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.330097 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.330303 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.330394 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.332967 (+ 2573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:60503: BlockingRecv error: recv got EOF from 127.24.71.193:60503 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:32.337904 5392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:32.333502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:51431)
0808 09:58:32.333571 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:32.333582 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:32.333624 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:32.333800 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:32.333801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:32.333981 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:32.334020 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.334022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.334648 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.334649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.335152 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.335153 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.335618 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.335619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.335673 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.336131 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:32.336136 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:32.337816 (+ 1680us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 09:58:32.337953 5393 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:32.333584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:51431 (local address 127.24.71.254:43131)
0808 09:58:32.333658 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:32.333660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:32.333669 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:32.333693 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:32.333693 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:32.333708 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:32.333797 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:32.334093 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.334563 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.335238 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.335531 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.335619 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.337887 (+ 2268us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:51431: BlockingRecv error: recv got EOF from 127.24.71.193:51431 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 09:58:32.338187 5388 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 09:58:32.407606 5394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:32.407822 5394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:32.407847 5394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:32.409087 5394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:32.409138 5394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:32.409165 5394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:32.410640 5394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.194.keytab
--principal=oryx/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:42385
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=37443
--tserver_master_addrs=127.24.71.254:43131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:32.410894 5394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:32.411157 5394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:32.416146 5404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:32.416160 5401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:32.416224 5402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:32.416501 5394 server_base.cc:1034] running on GCE node
I20260808 09:58:32.416769 5394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:32.417017 5394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:32.418190 5394 hybrid_clock.cc:648] HybridClock initialized: now 1786183112418184 us; error 39 us; skew 500 ppm
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183112, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:32.420881 5394 init.cc:377] Logged in from keytab as oryx/127.24.71.194@KRBTEST.COM (short username oryx)
I20260808 09:58:32.421280 5394 webserver.cc:460] Webserver started at http://127.24.71.194:37443/ using document root <none> and password file <none>
I20260808 09:58:32.421465 5394 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:32.421515 5394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:32.422973 5394 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:32.423593 5413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:32.423771 5394 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:32.423862 5394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "9206aa143e7e4e86a8493f5700958c38"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "549b8d5e7a5969998669dd3a37927a82"
server_key_iv: "3f359597de2913b502f510966a8c2417"
server_key_version: "encryptionkey@0"
I20260808 09:58:32.424206 5394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:32.431810 5394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:32.434268 5394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:32.434429 5394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:32.434679 5394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:32.435003 5394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:32.435060 5394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:32.435104 5394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:32.435132 5394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:32.441147 5394 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:42385
I20260808 09:58:32.441222 5584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:42385 every 8 connection(s)
I20260808 09:58:32.441601 5394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:58:32.447351 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 5394
I20260808 09:58:32.447696 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:37029
--local_ip_for_outbound_sockets=127.24.71.195
--tserver_master_addrs=127.24.71.254:43131
--webserver_port=33093
--webserver_interface=127.24.71.195
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.71.195
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 09:58:32.450030 5393 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:32.442390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:46417 (local address 127.24.71.254:43131)
0808 09:58:32.442455 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:32.442457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:32.442675 (+ 218us) server_negotiation.cc:407] Connection header received
0808 09:58:32.443199 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:32.443201 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:32.443218 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:32.443283 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:32.444368 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.444954 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.446053 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.446256 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.446350 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.449974 (+ 3624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:46417: BlockingRecv error: recv got EOF from 127.24.71.194:46417 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 09:58:32.450095 5587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:32.442386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:46417)
0808 09:58:32.442554 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:32.442590 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:32.443090 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:32.443369 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:32.443373 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:32.444019 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:32.444213 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.444218 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.445064 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.445066 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.445963 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.445966 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.446363 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.446364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.446489 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.447019 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:32.447027 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:32.449885 (+ 2858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":75,"threads_started":1}
W20260808 09:58:32.450325 5585 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:43131 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.71.254:43131: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:32.455691 5587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:32.450565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:47793)
0808 09:58:32.450618 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:32.450630 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:32.450667 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:32.450836 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:32.450837 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:32.450997 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:32.451058 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.451060 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.451771 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.451772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.452678 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.452681 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.453022 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.453023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.453100 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.453521 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:32.453527 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:32.455591 (+ 2064us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 09:58:32.455724 5393 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:32.450642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:47793 (local address 127.24.71.254:43131)
0808 09:58:32.450716 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:32.450718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:32.450726 (+ 8us) server_negotiation.cc:407] Connection header received
0808 09:58:32.450748 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:32.450749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:32.450757 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:32.450811 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:32.451132 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.451695 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.452762 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.452943 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.453003 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.455676 (+ 2673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:47793: BlockingRecv error: recv got EOF from 127.24.71.194:47793 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:32.460754 5587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:32.455965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:39379)
0808 09:58:32.456102 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:32.456113 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:32.456165 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:32.456313 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:32.456314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:32.456472 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:32.456515 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.456516 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.457096 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.457097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.457978 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.457980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.458314 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.458315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.458382 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.458783 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:32.458788 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:32.460668 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":87,"threads_started":1}
W20260808 09:58:32.460803 5393 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:32.456022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:39379 (local address 127.24.71.254:43131)
0808 09:58:32.456059 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:32.456061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:32.456164 (+ 103us) server_negotiation.cc:407] Connection header received
0808 09:58:32.456227 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:32.456228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:32.456236 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:32.456284 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:32.456584 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.457018 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.458068 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.458235 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.458280 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.460739 (+ 2459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:39379: BlockingRecv error: recv got EOF from 127.24.71.194:39379 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 09:58:32.460907 5585 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 09:58:32.541076 5590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:32.541301 5590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:32.541326 5590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:32.542537 5590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:32.542585 5590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:32.542613 5590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:32.544124 5590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/krb5kdc/oryx_127.24.71.195.keytab
--principal=oryx/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:37029
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=33093
--tserver_master_addrs=127.24.71.254:43131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:32.544400 5590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:32.544663 5590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:32.549942 5599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:32.549976 5596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:32.549923 5597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:32.550168 5590 server_base.cc:1034] running on GCE node
I20260808 09:58:32.550397 5590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:32.550652 5590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:32.551777 5590 hybrid_clock.cc:648] HybridClock initialized: now 1786183112551756 us; error 37 us; skew 500 ppm
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183112, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:32.554332 5590 init.cc:377] Logged in from keytab as oryx/127.24.71.195@KRBTEST.COM (short username oryx)
I20260808 09:58:32.554811 5590 webserver.cc:460] Webserver started at http://127.24.71.195:33093/ using document root <none> and password file <none>
I20260808 09:58:32.555034 5590 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:32.555091 5590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:32.556499 5590 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:32.557050 5613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:32.557231 5590 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:32.557333 5590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "a81b567ad267487ab50137e3abdf0fa8"
format_stamp: "Formatted at 2026-08-08 09:58:31 on dist-test-slave-gw5c"
server_key: "8d7105c5e95aaa99cfc21933457ce74e"
server_key_iv: "9ad380cdea3125c5836bc44b071c1b40"
server_key_version: "encryptionkey@0"
I20260808 09:58:32.557684 5590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:32.576030 5590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:32.578042 5590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:32.578222 5590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:32.578476 5590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:32.578814 5590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:32.578869 5590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:32.578922 5590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:32.578951 5590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:32.584847 5590 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:37029
I20260808 09:58:32.584892 5782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:37029 every 8 connection(s)
I20260808 09:58:32.585335 5590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 09:58:32.593140 5393 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:32.586133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:38497 (local address 127.24.71.254:43131)
0808 09:58:32.586182 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:32.586184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:32.586402 (+ 218us) server_negotiation.cc:407] Connection header received
0808 09:58:32.586927 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:32.586928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:32.586938 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:32.586999 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:32.588074 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.588561 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.589582 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.589758 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.589808 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.593091 (+ 3283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:38497: BlockingRecv error: recv got EOF from 127.24.71.195:38497 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 09:58:32.593156 5789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:32.586106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:38497)
0808 09:58:32.586279 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:32.586325 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:32.586827 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:32.587076 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:32.587080 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:32.587779 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:32.587988 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.587994 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.588658 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.588659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.589500 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.589503 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.589829 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.589830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.589931 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.590420 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:32.590428 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:32.592998 (+ 2570us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":101,"threads_started":1}
W20260808 09:58:32.593439 5786 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:43131 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.71.254:43131: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
I20260808 09:58:32.595440 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 5590
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:32.598522 5789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:32.593712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:47551)
0808 09:58:32.593864 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:32.593874 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:32.593912 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:32.594055 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:32.594056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:32.594171 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:32.594215 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.594216 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.594887 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.594888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.595682 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.595685 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.596117 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.596118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.596202 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.596728 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:32.596733 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:32.598440 (+ 1707us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135}
W20260808 09:58:32.598577 5393 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:32.593878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:47551 (local address 127.24.71.254:43131)
0808 09:58:32.593945 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:32.593947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:32.593955 (+ 8us) server_negotiation.cc:407] Connection header received
0808 09:58:32.593978 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:32.593979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:32.593992 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:32.594039 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:32.594308 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.594820 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.595762 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.596043 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.596098 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.598514 (+ 2416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:47551: BlockingRecv error: recv got EOF from 127.24.71.195:47551 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:32 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:32.603070 5789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:32.598859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:32791)
0808 09:58:32.598911 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:32.598919 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:32.598947 (+ 28us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:32.599174 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:32.599175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:32.599291 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:32.599316 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.599317 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.599957 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.599958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.600434 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:32.600435 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.600787 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.600788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:32.600845 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.601259 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:32.601264 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:32.602991 (+ 1727us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 09:58:32.603149 5393 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:32.598998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:32791 (local address 127.24.71.254:43131)
0808 09:58:32.599065 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:32.599067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:32.599073 (+ 6us) server_negotiation.cc:407] Connection header received
0808 09:58:32.599088 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:32.599088 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:32.599095 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:32.599153 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:32.599423 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.599859 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.600528 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.600715 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.600788 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.603057 (+ 2269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:32791: BlockingRecv error: recv got EOF from 127.24.71.195:32791 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 09:58:32.603457 5786 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 09:58:32.604009 5792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:32.595858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57712 (local address 127.24.71.254:43131)
0808 09:58:32.596198 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:32.596200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:32.596207 (+ 7us) server_negotiation.cc:407] Connection header received
0808 09:58:32.596229 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:32.596230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:32.596241 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:32.596308 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:32.597072 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.597687 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.598514 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:32.598831 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:32.598894 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:32.600251 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:32.600260 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:32.600260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:32.600272 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:32.602334 (+ 2062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:32.602728 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:32.602732 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:32.602733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:32.602837 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:32.603067 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:32.603068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:32.603068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:32.603371 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:32.603556 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:32.603776 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 09:58:32.603906 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":93,"threads_started":1}
Aug 08 09:58:33 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:33 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:33.343847 5793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:33.338634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:54671)
0808 09:58:33.338770 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:33.338787 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:33.338843 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:33.339002 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:33.339002 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:33.339183 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:33.339234 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:33.339236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:33.340027 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:33.340028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:33.340609 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:33.340612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:33.341033 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:33.341035 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:33.341092 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:33.341574 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:33.341580 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:33.343760 (+ 2180us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":82,"threads_started":1}
W20260808 09:58:33.343971 5794 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:33.338699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:54671 (local address 127.24.71.254:43131)
0808 09:58:33.338840 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:33.338842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:33.338854 (+ 12us) server_negotiation.cc:407] Connection header received
0808 09:58:33.338900 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:33.338901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:33.338912 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:33.338995 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:33.339353 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:33.339929 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:33.340699 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:33.340936 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:33.341003 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:33.343881 (+ 2878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:54671: BlockingRecv error: recv got EOF from 127.24.71.193:54671 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":80,"threads_started":1}
Aug 08 09:58:33 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:33 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:33.466173 5795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:33.461408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:58267)
0808 09:58:33.461557 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:33.461568 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:33.461654 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:33.461804 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:33.461805 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:33.462005 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:33.462054 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:33.462056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:33.462745 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:33.462747 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:33.463292 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:33.463294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:33.463733 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:33.463734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:33.463800 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:33.464263 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:33.464268 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:33.466069 (+ 1801us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":77,"threads_started":1}
W20260808 09:58:33.466230 5794 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:33.461471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:58267 (local address 127.24.71.254:43131)
0808 09:58:33.461547 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:33.461549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:33.461639 (+ 90us) server_negotiation.cc:407] Connection header received
0808 09:58:33.461711 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:33.461712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:33.461725 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:33.461778 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:33.462142 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:33.462648 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:33.463419 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:33.463622 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:33.463714 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:33.466162 (+ 2448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:58267: BlockingRecv error: recv got EOF from 127.24.71.194:58267 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 09:58:33 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:33 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:33.609133 5797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:33.603965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:40189)
0808 09:58:33.604104 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:33.604121 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:33.604176 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:33.604432 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:33.604433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:33.604625 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:33.604682 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:33.604684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:33.605399 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:33.605400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:33.606166 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:33.606169 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:33.606599 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:33.606600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:33.606648 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:33.607175 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:33.607180 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:33.609066 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
W20260808 09:58:33.609292 5794 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:33.604109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:40189 (local address 127.24.71.254:43131)
0808 09:58:33.604181 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:33.604183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:33.604224 (+ 41us) server_negotiation.cc:407] Connection header received
0808 09:58:33.604251 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:33.604252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:33.604321 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:33.604370 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:33.604769 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:33.605286 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:33.606309 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:33.606529 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:33.606593 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:33.609208 (+ 2615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:40189: BlockingRecv error: recv got EOF from 127.24.71.195:40189 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 09:58:34 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:34 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:34.349426 5800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:34.344373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:42519)
0808 09:58:34.344557 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:34.344571 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:34.344640 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:34.344772 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:34.344773 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:34.344964 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:34.345018 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:34.345020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:34.345740 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:34.345742 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:34.346301 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:34.346304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:34.346701 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:34.346702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:34.346762 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:34.347234 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:34.347240 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:34.349326 (+ 2086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":94,"threads_started":1}
W20260808 09:58:34.349485 5801 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:34.344461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:42519 (local address 127.24.71.254:43131)
0808 09:58:34.344569 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:34.344571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:34.344640 (+ 69us) server_negotiation.cc:407] Connection header received
0808 09:58:34.344682 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:34.344683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:34.344693 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:34.344763 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:34.345108 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:34.345639 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:34.346404 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:34.346609 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:34.346698 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:34.349412 (+ 2714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:42519: BlockingRecv error: recv got EOF from 127.24.71.193:42519 (error 108)
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":55,"threads_started":1}
Aug 08 09:58:34 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:34 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:34.471984 5802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:34.466713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:50557)
0808 09:58:34.466898 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:34.466912 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:34.467012 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:34.467189 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:34.467190 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:34.467469 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:34.467537 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:34.467540 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:34.468290 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:34.468291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:34.468830 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:34.468831 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:34.469254 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:34.469255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:34.469313 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:34.469865 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:34.469870 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:34.471882 (+ 2012us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":92,"threads_started":1}
W20260808 09:58:34.472040 5801 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:34.466814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:50557 (local address 127.24.71.254:43131)
0808 09:58:34.466911 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:34.466914 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:34.466988 (+ 74us) server_negotiation.cc:407] Connection header received
0808 09:58:34.467090 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:34.467091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:34.467106 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:34.467184 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:34.467628 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:34.468154 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:34.468934 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:34.469149 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:34.469255 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:34.471972 (+ 2717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:50557: BlockingRecv error: recv got EOF from 127.24.71.194:50557 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 09:58:34 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:34 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:34.614394 5803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:34.609685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:52745)
0808 09:58:34.609910 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:34.609924 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:34.609995 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:34.610129 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:34.610130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:34.610346 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:34.610413 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:34.610415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:34.611082 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:34.611083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:34.611654 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:34.611656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:34.612019 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:34.612020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:34.612060 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:34.612535 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:34.612540 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:34.614334 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":111,"threads_started":1}
W20260808 09:58:34.614477 5801 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:34.609890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:52745 (local address 127.24.71.254:43131)
0808 09:58:34.609960 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:34.609962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:34.609978 (+ 16us) server_negotiation.cc:407] Connection header received
0808 09:58:34.610043 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:34.610044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:34.610055 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:34.610106 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:34.610488 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:34.610985 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:34.611751 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:34.611948 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:34.612007 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:34.614428 (+ 2421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:52745: BlockingRecv error: recv got EOF from 127.24.71.195:52745 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 09:58:35 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:35 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:35.354763 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:35.349941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:59165)
0808 09:58:35.350109 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:35.350120 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:35.350182 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:35.350325 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:35.350326 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:35.350522 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:35.350589 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:35.350591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:35.351337 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:35.351338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:35.351966 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:35.351968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:35.352320 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:35.352321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:35.352364 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:35.352884 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:35.352889 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:35.354684 (+ 1795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":103,"threads_started":1}
W20260808 09:58:35.354888 5805 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:35.350035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:59165 (local address 127.24.71.254:43131)
0808 09:58:35.350184 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:35.350186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:35.350214 (+ 28us) server_negotiation.cc:407] Connection header received
0808 09:58:35.350236 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:35.350236 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:35.350246 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:35.350296 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:35.350699 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:35.351230 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:35.352046 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:35.352246 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:35.352305 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:35.354778 (+ 2473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:59165: BlockingRecv error: recv got EOF from 127.24.71.193:59165 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":96,"threads_started":1}
Aug 08 09:58:35 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:35 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:35.477835 5806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:35.472683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:56871)
0808 09:58:35.472850 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:35.472862 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:35.472922 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:35.473117 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:35.473118 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:35.473343 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:35.473393 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:35.473395 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:35.474150 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:35.474152 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:35.474701 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:35.474703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:35.475097 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:35.475098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:35.475138 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:35.475728 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:35.475733 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:35.477763 (+ 2030us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":108,"threads_started":1}
W20260808 09:58:35.477908 5805 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:35.472797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:56871 (local address 127.24.71.254:43131)
0808 09:58:35.472904 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:35.472906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:35.472921 (+ 15us) server_negotiation.cc:407] Connection header received
0808 09:58:35.472978 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:35.472979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:35.472992 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:35.473066 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:35.473501 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:35.474037 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:35.474825 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:35.475019 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:35.475086 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:35.477861 (+ 2775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:56871: BlockingRecv error: recv got EOF from 127.24.71.194:56871 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 09:58:35 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:35 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:35.620117 5808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:35.615091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:35527)
0808 09:58:35.615362 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:35.615374 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:35.615492 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:35.615632 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:35.615632 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:35.615826 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:35.615876 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:35.615878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:35.616590 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:35.616591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:35.617132 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:35.617134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:35.617524 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:35.617525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:35.617587 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:35.618094 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:35.618100 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:35.620004 (+ 1904us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":125,"threads_started":1}
W20260808 09:58:35.620177 5805 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:35.615210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:35527 (local address 127.24.71.254:43131)
0808 09:58:35.615315 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:35.615318 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:35.615471 (+ 153us) server_negotiation.cc:407] Connection header received
0808 09:58:35.615549 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:35.615550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:35.615566 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:35.615615 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:35.615961 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:35.616496 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:35.617226 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:35.617429 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:35.617521 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:35.620102 (+ 2581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:35527: BlockingRecv error: recv got EOF from 127.24.71.195:35527 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 08 09:58:36 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:36 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:36.360270 5811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:36.355322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:32881)
0808 09:58:36.355495 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:36.355508 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:36.355574 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:36.355699 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:36.355700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:36.355871 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:36.355921 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:36.355922 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:36.356596 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:36.356597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:36.357116 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:36.357117 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:36.357475 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:36.357476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:36.357515 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:36.358061 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:36.358067 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:36.360169 (+ 2102us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":95,"threads_started":1}
W20260808 09:58:36.360319 5809 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:36.355322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:32881 (local address 127.24.71.254:43131)
0808 09:58:36.355500 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:36.355502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:36.355558 (+ 56us) server_negotiation.cc:407] Connection header received
0808 09:58:36.355617 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:36.355617 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:36.355627 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:36.355694 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:36.355991 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:36.356513 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:36.357191 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:36.357404 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:36.357463 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:36.360250 (+ 2787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:32881: BlockingRecv error: recv got EOF from 127.24.71.193:32881 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":98,"threads_started":1}
Aug 08 09:58:36 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:36 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:36.482944 5812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:36.478417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:49113)
0808 09:58:36.478569 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:36.478582 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:36.478652 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:36.478801 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:36.478802 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:36.478995 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:36.479046 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:36.479048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:36.479799 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:36.479799 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:36.480347 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:36.480348 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:36.480682 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:36.480683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:36.480723 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:36.481158 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:36.481163 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:36.482882 (+ 1719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":99,"threads_started":1}
W20260808 09:58:36.483070 5809 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:36.478503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:49113 (local address 127.24.71.254:43131)
0808 09:58:36.478586 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:36.478590 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:36.478653 (+ 63us) server_negotiation.cc:407] Connection header received
0808 09:58:36.478700 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:36.478701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:36.478712 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:36.478767 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:36.479110 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:36.479717 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:36.480428 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:36.480612 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:36.480665 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:36.482994 (+ 2329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:49113: BlockingRecv error: recv got EOF from 127.24.71.194:49113 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 08 09:58:36 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:36 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:36.625358 5813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:36.620747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:45203)
0808 09:58:36.620918 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:36.620928 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:36.620987 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:36.621101 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:36.621102 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:36.621269 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:36.621319 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:36.621320 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:36.621981 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:36.621982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:36.622511 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:36.622513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:36.622844 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:36.622844 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:36.622882 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:36.623459 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:36.623465 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:36.625298 (+ 1833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":107,"threads_started":1}
W20260808 09:58:36.625543 5809 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:36.620826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:45203 (local address 127.24.71.254:43131)
0808 09:58:36.620900 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:36.620902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:36.620991 (+ 89us) server_negotiation.cc:407] Connection header received
0808 09:58:36.621042 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:36.621042 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:36.621052 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:36.621090 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:36.621395 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:36.621894 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:36.622588 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:36.622777 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:36.622831 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:36.625425 (+ 2594us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:45203: BlockingRecv error: recv got EOF from 127.24.71.195:45203 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 09:58:37 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:37 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:37.369609 5816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:37.361179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:34899)
0808 09:58:37.361341 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:37.361351 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:37.361437 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:37.361650 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:37.361651 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:37.361877 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:37.361947 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:37.361950 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:37.362695 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:37.362696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:37.363222 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:37.363224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:37.363628 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:37.363629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:37.363683 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:37.367628 (+ 3945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:37.367633 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:37.369507 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":104,"threads_started":1}
W20260808 09:58:37.369673 5817 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:37.361228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:34899 (local address 127.24.71.254:43131)
0808 09:58:37.361375 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:37.361377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:37.361439 (+ 62us) server_negotiation.cc:407] Connection header received
0808 09:58:37.361507 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:37.361508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:37.361519 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:37.361616 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:37.362074 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:37.362614 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:37.363301 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:37.363551 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:37.363606 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:37.369599 (+ 5993us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:34899: BlockingRecv error: recv got EOF from 127.24.71.193:34899 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":83,"threads_started":1}
Aug 08 09:58:37 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:37 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:37.490625 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:37.483497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:43465)
0808 09:58:37.483639 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:37.483651 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:37.483704 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:37.483877 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:37.483878 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:37.484148 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:37.484221 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:37.484224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:37.486820 (+ 2596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:37.486820 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:37.487435 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:37.487437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:37.487931 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:37.487932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:37.488024 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:37.488641 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:37.488647 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:37.490563 (+ 1916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":74,"threads_started":1}
W20260808 09:58:37.490737 5817 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:37.483604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:43465 (local address 127.24.71.254:43131)
0808 09:58:37.483674 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:37.483676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:37.483690 (+ 14us) server_negotiation.cc:407] Connection header received
0808 09:58:37.483788 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:37.483789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:37.483802 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:37.483872 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:37.486230 (+ 2358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:37.486740 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:37.487513 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:37.487807 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:37.487903 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:37.490666 (+ 2763us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:43465: BlockingRecv error: recv got EOF from 127.24.71.194:43465 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 09:58:37 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:37 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:37.630529 5821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:37.625904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:37737)
0808 09:58:37.626084 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:37.626095 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:37.626190 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:37.626358 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:37.626359 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:37.626538 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:37.626590 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:37.626592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:37.627293 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:37.627295 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:37.627872 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:37.627874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:37.628207 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:37.628208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:37.628254 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:37.628707 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:37.628711 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:37.630457 (+ 1746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":123,"threads_started":1}
W20260808 09:58:37.630631 5817 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:37.625949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:37737 (local address 127.24.71.254:43131)
0808 09:58:37.626021 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:37.626023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:37.626160 (+ 137us) server_negotiation.cc:407] Connection header received
0808 09:58:37.626267 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:37.626267 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:37.626280 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:37.626322 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:37.626663 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:37.627161 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:37.627952 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:37.628136 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:37.628192 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:37.630562 (+ 2370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:37737: BlockingRecv error: recv got EOF from 127.24.71.195:37737 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 09:58:38 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:38 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:38.375038 5822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:38.370176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:56939)
0808 09:58:38.370335 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:38.370350 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:38.370426 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:38.370619 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:38.370620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:38.370836 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:38.370901 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:38.370904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:38.371655 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:38.371656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:38.372200 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:38.372202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:38.372550 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:38.372552 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:38.372603 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:38.373158 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:38.373164 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:38.374978 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":96,"threads_started":1}
W20260808 09:58:38.375192 5823 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:38.370229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:56939 (local address 127.24.71.254:43131)
0808 09:58:38.370358 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:38.370359 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:38.370390 (+ 31us) server_negotiation.cc:407] Connection header received
0808 09:58:38.370515 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:38.370516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:38.370530 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:38.370599 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:38.371010 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:38.371580 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:38.372270 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:38.372459 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:38.372511 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:38.375097 (+ 2586us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:56939: BlockingRecv error: recv got EOF from 127.24.71.193:56939 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":70,"threads_started":1}
Aug 08 09:58:38 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:38 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:38.496594 5825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:38.491481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:52139)
0808 09:58:38.491651 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:38.491666 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:38.491742 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:38.491903 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:38.491904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:38.492138 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:38.492204 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:38.492206 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:38.492995 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:38.492996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:38.493519 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:38.493520 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:38.493955 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:38.493956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:38.494081 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:38.494560 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:38.494565 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:38.496532 (+ 1967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":86,"threads_started":1}
W20260808 09:58:38.496718 5823 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:38.491577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:52139 (local address 127.24.71.254:43131)
0808 09:58:38.491634 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:38.491642 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:38.491748 (+ 106us) server_negotiation.cc:407] Connection header received
0808 09:58:38.491805 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:38.491806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:38.491821 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:38.491879 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:38.492289 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:38.492925 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:38.493601 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:38.493851 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:38.493922 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:38.496637 (+ 2715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:52139: BlockingRecv error: recv got EOF from 127.24.71.194:52139 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 08 09:58:38 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:38 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:38.635744 5826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:38.631043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:53213)
0808 09:58:38.631190 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:38.631201 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:38.631260 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:38.631443 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:38.631444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:38.631636 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:38.631701 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:38.631703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:38.632344 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:38.632345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:38.632867 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:38.632868 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:38.633187 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:38.633188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:38.633239 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:38.633693 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:38.633698 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:38.635685 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":80,"threads_started":1}
W20260808 09:58:38.635891 5823 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:38.631124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:53213 (local address 127.24.71.254:43131)
0808 09:58:38.631233 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:38.631235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:38.631248 (+ 13us) server_negotiation.cc:407] Connection header received
0808 09:58:38.631322 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:38.631323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:38.631336 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:38.631433 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:38.631771 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:38.632270 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:38.632944 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:38.633120 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:38.633171 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:38.635805 (+ 2634us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:53213: BlockingRecv error: recv got EOF from 127.24.71.195:53213 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 09:58:39 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:39 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:39.380975 5827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:39.375573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:38771)
0808 09:58:39.375726 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:39.375741 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:39.375823 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:39.376065 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:39.376066 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:39.376294 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:39.376359 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:39.376361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:39.377057 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:39.377058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:39.377835 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:39.377838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:39.378238 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:39.378239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:39.378302 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:39.378789 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:39.378794 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:39.380912 (+ 2118us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":73,"threads_started":1}
W20260808 09:58:39.381088 5828 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:39.375657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:38771 (local address 127.24.71.254:43131)
0808 09:58:39.375804 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:39.375807 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:39.375818 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:58:39.375917 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:39.375918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:39.375931 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:39.375994 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:39.376439 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:39.376960 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:39.377939 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:39.378147 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:39.378226 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:39.381014 (+ 2788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:38771: BlockingRecv error: recv got EOF from 127.24.71.193:38771 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
Aug 08 09:58:39 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:39 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:39.502329 5829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:39.497143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:44347)
0808 09:58:39.497339 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:39.497350 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:39.497402 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:39.497559 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:39.497560 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:39.497735 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:39.497784 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:39.497786 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:39.498527 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:39.498528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:39.499068 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:39.499070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:39.499490 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:39.499490 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:39.499532 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:39.500163 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:39.500168 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:39.502230 (+ 2062us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":128,"threads_started":1}
W20260808 09:58:39.502504 5828 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:39.497305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:44347 (local address 127.24.71.254:43131)
0808 09:58:39.497391 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:39.497393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:39.497407 (+ 14us) server_negotiation.cc:407] Connection header received
0808 09:58:39.497454 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:39.497455 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:39.497468 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:39.497539 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:39.497874 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:39.498441 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:39.499160 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:39.499416 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:39.499484 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:39.502419 (+ 2935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:44347: BlockingRecv error: recv got EOF from 127.24.71.194:44347 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 09:58:39 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:39 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:39.641004 5834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:39.636315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:45493)
0808 09:58:39.636533 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:39.636545 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:39.636612 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:39.636732 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:39.636733 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:39.636909 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:39.636960 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:39.636961 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:39.637615 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:39.637615 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:39.638128 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:39.638129 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:39.638532 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:39.638532 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:39.638573 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:39.639075 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:39.639080 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:39.640942 (+ 1862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":128,"threads_started":1}
W20260808 09:58:39.641129 5828 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:39.636395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:45493 (local address 127.24.71.254:43131)
0808 09:58:39.636472 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:39.636475 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:39.636614 (+ 139us) server_negotiation.cc:407] Connection header received
0808 09:58:39.636658 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:39.636659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:39.636673 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:39.636720 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:39.637020 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:39.637538 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:39.638236 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:39.638455 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:39.638515 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:39.641048 (+ 2533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:45493: BlockingRecv error: recv got EOF from 127.24.71.195:45493 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 09:58:40 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:40 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:40.386351 5835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:40.381561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:51307)
0808 09:58:40.381724 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:40.381738 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:40.381803 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:40.382019 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:40.382020 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:40.382192 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:40.382243 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:40.382245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:40.382920 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:40.382921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:40.383504 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:40.383506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:40.383873 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:40.383874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:40.383914 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:40.384391 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:40.384396 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:40.386292 (+ 1896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":59,"threads_started":1}
W20260808 09:58:40.386495 5836 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:40.381743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:51307 (local address 127.24.71.254:43131)
0808 09:58:40.381896 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:40.381898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:40.381907 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:40.381929 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:40.381929 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:40.381939 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:40.382000 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:40.382328 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:40.382842 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:40.383592 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:40.383804 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:40.383863 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:40.386401 (+ 2538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:51307: BlockingRecv error: recv got EOF from 127.24.71.193:51307 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
Aug 08 09:58:40 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:40 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:40.507719 5838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:40.502827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:49299)
0808 09:58:40.502981 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:40.502991 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:40.503038 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:40.503183 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:40.503183 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:40.503365 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:40.503436 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:40.503438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:40.504235 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:40.504236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:40.504756 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:40.504757 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:40.505098 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:40.505098 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:40.505139 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:40.505669 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:40.505674 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:40.507658 (+ 1984us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":87,"threads_started":1}
W20260808 09:58:40.507884 5836 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:40.502930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:49299 (local address 127.24.71.254:43131)
0808 09:58:40.503014 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:40.503015 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:40.503026 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:58:40.503094 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:40.503094 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:40.503106 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:40.503167 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:40.503508 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:40.504165 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:40.504834 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:40.505029 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:40.505083 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:40.507798 (+ 2715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:49299: BlockingRecv error: recv got EOF from 127.24.71.194:49299 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 08 09:58:40 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:40 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:40.646869 5839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:40.641572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:58899)
0808 09:58:40.641798 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:40.641810 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:40.641884 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:40.642032 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:40.642033 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:40.642224 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:40.642274 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:40.642275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:40.643021 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:40.643022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:40.643905 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:40.643908 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:40.644243 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:40.644243 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:40.644307 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:40.644897 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:40.644902 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:40.646809 (+ 1907us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":135,"threads_started":1}
W20260808 09:58:40.646982 5836 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:40.641696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:58899 (local address 127.24.71.254:43131)
0808 09:58:40.641784 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:40.641786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:40.641863 (+ 77us) server_negotiation.cc:407] Connection header received
0808 09:58:40.641941 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:40.641942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:40.641957 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:40.642012 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:40.642367 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:40.642875 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:40.643982 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:40.644175 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:40.644233 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:40.646903 (+ 2670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:58899: BlockingRecv error: recv got EOF from 127.24.71.195:58899 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 09:58:41 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:41 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:41.392416 5840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:41.386981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:59151)
0808 09:58:41.387136 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:41.387148 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:41.387213 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:41.387457 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:41.387458 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:41.387652 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:41.387707 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:41.387709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:41.388491 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:41.388493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:41.389042 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:41.389044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:41.389466 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:41.389467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:41.389524 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:41.390179 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:41.390186 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:41.392356 (+ 2170us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":96,"threads_started":1}
W20260808 09:58:41.392581 5846 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:41.387109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:59151 (local address 127.24.71.254:43131)
0808 09:58:41.387254 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:41.387256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:41.387267 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:58:41.387296 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:41.387297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:41.387312 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:41.387438 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:41.387824 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:41.388387 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:41.389132 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:41.389344 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:41.389406 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:41.392485 (+ 3079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:59151: BlockingRecv error: recv got EOF from 127.24.71.193:59151 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":88,"threads_started":1}
Aug 08 09:58:41 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:41 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:41.513625 5848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:41.508304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:52313)
0808 09:58:41.508481 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:41.508514 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:41.508598 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:41.508793 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:41.508794 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:41.508997 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:41.509053 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:41.509055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:41.509751 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:41.509752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:41.510325 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:41.510328 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:41.510835 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:41.510836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:41.510906 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:41.511465 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:41.511470 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:41.513514 (+ 2044us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":106,"threads_started":1}
W20260808 09:58:41.513684 5846 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:41.508474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:52313 (local address 127.24.71.254:43131)
0808 09:58:41.508554 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:41.508556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:41.508576 (+ 20us) server_negotiation.cc:407] Connection header received
0808 09:58:41.508685 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:41.508687 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:41.508702 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:41.508776 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:41.509148 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:41.509659 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:41.510479 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:41.510739 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:41.510833 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:41.513612 (+ 2779us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:52313: BlockingRecv error: recv got EOF from 127.24.71.194:52313 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 09:58:41 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:41 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:41.652707 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:41.647523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:33947)
0808 09:58:41.647735 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:41.647747 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:41.647823 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:41.647969 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:41.647970 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:41.648149 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:41.648200 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:41.648202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:41.648919 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:41.648920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:41.649535 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:41.649537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:41.649907 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:41.649907 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:41.649949 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:41.650496 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:41.650501 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:41.652604 (+ 2103us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":119,"threads_started":1}
W20260808 09:58:41.652758 5846 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:41.647601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:33947 (local address 127.24.71.254:43131)
0808 09:58:41.647685 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:41.647688 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:41.647821 (+ 133us) server_negotiation.cc:407] Connection header received
0808 09:58:41.647884 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:41.647884 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:41.647899 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:41.647942 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:41.648290 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:41.648798 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:41.649649 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:41.649834 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:41.649891 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:41.652690 (+ 2799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:33947: BlockingRecv error: recv got EOF from 127.24.71.195:33947 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 09:58:42 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:42 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:42.401223 5850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:42.392980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:50773)
0808 09:58:42.393152 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:42.393173 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:42.393280 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:42.393524 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:42.393525 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:42.393756 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:42.393817 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:42.393819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:42.394495 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:42.394496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:42.395102 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:42.395104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:42.395548 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:42.395550 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:42.395600 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:42.398948 (+ 3348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:42.398953 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:42.401111 (+ 2158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":110,"threads_started":1}
W20260808 09:58:42.401325 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:42.393061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:50773 (local address 127.24.71.254:43131)
0808 09:58:42.393224 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:42.393227 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:42.393239 (+ 12us) server_negotiation.cc:407] Connection header received
0808 09:58:42.393353 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:42.393354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:42.393365 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:42.393486 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:42.393902 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:42.394420 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:42.395203 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:42.395472 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:42.395532 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:42.401201 (+ 5669us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:50773: BlockingRecv error: recv got EOF from 127.24.71.193:50773 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":101,"threads_started":1}
Aug 08 09:58:42 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:42 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:42.519511 5852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:42.514210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:57949)
0808 09:58:42.514446 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:42.514468 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:42.514542 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:42.514802 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:42.514803 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:42.514984 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:42.515037 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:42.515039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:42.515801 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:42.515803 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:42.516350 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:42.516352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:42.516774 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:42.516775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:42.516829 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:42.517393 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:42.517399 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:42.519431 (+ 2032us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":174,"threads_started":1}
W20260808 09:58:42.519676 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:42.514332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:57949 (local address 127.24.71.254:43131)
0808 09:58:42.514385 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:42.514387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:42.514541 (+ 154us) server_negotiation.cc:407] Connection header received
0808 09:58:42.514606 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:42.514607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:42.514618 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:42.514675 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:42.515113 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:42.515705 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:42.516466 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:42.516672 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:42.516745 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:42.519589 (+ 2844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:57949: BlockingRecv error: recv got EOF from 127.24.71.194:57949 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 09:58:42 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:42 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:42.658921 5854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:42.653418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:49161)
0808 09:58:42.653623 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:42.653633 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:42.653720 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:42.653873 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:42.653873 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:42.654044 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:42.654095 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:42.654097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:42.655010 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:42.655011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:42.655639 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:42.655641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:42.656221 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:42.656222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:42.656263 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:42.656717 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:42.656722 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:42.658850 (+ 2128us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":110,"threads_started":1}
W20260808 09:58:42.659062 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:42.653576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:49161 (local address 127.24.71.254:43131)
0808 09:58:42.653628 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:42.653630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:42.653728 (+ 98us) server_negotiation.cc:407] Connection header received
0808 09:58:42.653780 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:42.653781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:42.653793 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:42.653849 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:42.654210 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:42.654902 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:42.655746 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:42.656133 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:42.656208 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:42.658956 (+ 2748us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:49161: BlockingRecv error: recv got EOF from 127.24.71.195:49161 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 08 09:58:43 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:43 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:43.406960 5855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:43.401792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:43403)
0808 09:58:43.401979 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:43.401991 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:43.402060 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:43.402230 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:43.402231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:43.402429 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:43.402482 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:43.402484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:43.403198 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:43.403199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:43.403804 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:43.403807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:43.404208 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:43.404209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:43.404254 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:43.404731 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:43.404737 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:43.406878 (+ 2141us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":100,"threads_started":1}
W20260808 09:58:43.407122 5856 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:43.401912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:43403 (local address 127.24.71.254:43131)
0808 09:58:43.402097 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:43.402099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:43.402109 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:43.402135 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:43.402135 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:43.402147 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:43.402214 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:43.402562 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:43.403094 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:43.403915 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:43.404127 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:43.404196 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:43.406993 (+ 2797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:43403: BlockingRecv error: recv got EOF from 127.24.71.193:43403 (error 108)
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":111,"threads_started":1}
Aug 08 09:58:43 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:43 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:43.525090 5857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:43.520042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:40945)
0808 09:58:43.520178 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:43.520191 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:43.520257 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:43.520417 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:43.520418 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:43.520620 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:43.520667 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:43.520669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:43.521363 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:43.521365 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:43.521906 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:43.521908 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:43.522314 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:43.522315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:43.522380 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:43.522880 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:43.522885 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:43.524971 (+ 2086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
W20260808 09:58:43.525135 5856 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:43.520157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:40945 (local address 127.24.71.254:43131)
0808 09:58:43.520220 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:43.520222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:43.520236 (+ 14us) server_negotiation.cc:407] Connection header received
0808 09:58:43.520328 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:43.520329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:43.520345 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:43.520407 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:43.520755 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:43.521264 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:43.522000 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:43.522201 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:43.522299 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:43.525066 (+ 2767us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:40945: BlockingRecv error: recv got EOF from 127.24.71.194:40945 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 08 09:58:43 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:43 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:43.664708 5859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:43.659585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:55581)
0808 09:58:43.659788 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:43.659803 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:43.659912 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:43.660107 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:43.660108 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:43.660307 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:43.660359 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:43.660361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:43.661044 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:43.661044 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:43.661687 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:43.661689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:43.662101 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:43.662102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:43.662159 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:43.662652 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:43.662657 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:43.664628 (+ 1971us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":96,"threads_started":1}
W20260808 09:58:43.664783 5856 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:43.659699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:55581 (local address 127.24.71.254:43131)
0808 09:58:43.659792 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:43.659795 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:43.659906 (+ 111us) server_negotiation.cc:407] Connection header received
0808 09:58:43.659992 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:43.659993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:43.660008 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:43.660063 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:43.660441 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:43.660965 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:43.661809 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:43.662014 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:43.662103 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:43.664733 (+ 2630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:55581: BlockingRecv error: recv got EOF from 127.24.71.195:55581 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 09:58:44 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:44 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:44.412339 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:44.407609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:48367)
0808 09:58:44.407762 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:44.407778 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:44.407841 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:44.408027 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:44.408027 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:44.408210 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:44.408267 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:44.408269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:44.408989 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:44.408990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:44.409507 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:44.409508 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:44.409853 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:44.409854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:44.409894 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:44.410419 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:44.410424 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:44.412275 (+ 1851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":96,"threads_started":1}
W20260808 09:58:44.412533 5863 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:44.407703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:48367 (local address 127.24.71.254:43131)
0808 09:58:44.407878 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:44.407884 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:44.407894 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:44.407915 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:44.407916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:44.407927 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:44.408002 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:44.408385 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:44.408910 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:44.409583 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:44.409776 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:44.409831 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:44.412440 (+ 2609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:48367: BlockingRecv error: recv got EOF from 127.24.71.193:48367 (error 108)
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":116,"threads_started":1}
Aug 08 09:58:44 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:44 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:44.530738 5864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:44.525604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:45973)
0808 09:58:44.525780 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:44.525794 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:44.525888 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:44.526067 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:44.526068 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:44.526280 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:44.526329 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:44.526331 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:44.527136 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:44.527138 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:44.527738 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:44.527741 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:44.528176 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:44.528178 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:44.528237 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:44.528787 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:44.528792 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:44.530640 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":90,"threads_started":1}
W20260808 09:58:44.530789 5863 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:44.525709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:45973 (local address 127.24.71.254:43131)
0808 09:58:44.525784 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:44.525787 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:44.525865 (+ 78us) server_negotiation.cc:407] Connection header received
0808 09:58:44.525968 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:44.525969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:44.525982 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:44.526061 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:44.526435 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:44.527041 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:44.527824 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:44.528084 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:44.528179 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:44.530724 (+ 2545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:45973: BlockingRecv error: recv got EOF from 127.24.71.194:45973 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 09:58:44 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:44 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:44.670382 5866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:44.665345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:34585)
0808 09:58:44.665526 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:44.665543 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:44.665609 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:44.665757 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:44.665758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:44.665947 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:44.665997 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:44.665998 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:44.666725 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:44.666726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:44.667274 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:44.667275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:44.667742 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:44.667743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:44.667802 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:44.668356 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:44.668361 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:44.670321 (+ 1960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":123,"threads_started":1}
W20260808 09:58:44.670522 5863 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:44.665438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:34585 (local address 127.24.71.254:43131)
0808 09:58:44.665534 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:44.665536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:44.665614 (+ 78us) server_negotiation.cc:407] Connection header received
0808 09:58:44.665656 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:44.665657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:44.665670 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:44.665734 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:44.666067 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:44.666635 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:44.667423 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:44.667645 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:44.667716 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:44.670437 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:34585: BlockingRecv error: recv got EOF from 127.24.71.195:34585 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 09:58:45 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:45 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:45.418268 5868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:45.412958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:52333)
0808 09:58:45.413094 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:45.413104 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:45.413152 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:45.413507 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:45.413508 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:45.413728 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:45.413780 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:45.413782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:45.414534 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:45.414534 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:45.415084 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:45.415085 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:45.415563 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:45.415564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:45.415608 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:45.416157 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:45.416162 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:45.418198 (+ 2036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":64,"threads_started":1}
W20260808 09:58:45.418433 5870 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:45.413143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:52333 (local address 127.24.71.254:43131)
0808 09:58:45.413337 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:45.413339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:45.413349 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:45.413378 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:45.413379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:45.413390 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:45.413470 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:45.413900 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:45.414457 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:45.415174 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:45.415493 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:45.415554 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:45.418335 (+ 2781us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:52333: BlockingRecv error: recv got EOF from 127.24.71.193:52333 (error 108)
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":115,"threads_started":1}
Aug 08 09:58:45 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:45 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:45.536237 5871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:45.531274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:60333)
0808 09:58:45.531450 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:45.531469 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:45.531558 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:45.531729 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:45.531730 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:45.531927 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:45.531974 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:45.531975 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:45.532661 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:45.532662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:45.533187 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:45.533188 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:45.533589 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:45.533590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:45.533648 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:45.534169 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:45.534173 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:45.536139 (+ 1966us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":62,"threads_started":1}
W20260808 09:58:45.536293 5870 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:45.531479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:60333 (local address 127.24.71.254:43131)
0808 09:58:45.531552 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:45.531554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:45.531564 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:45.531629 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:45.531630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:45.531645 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:45.531720 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:45.532061 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:45.532562 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:45.533294 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:45.533497 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:45.533590 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:45.536235 (+ 2645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:60333: BlockingRecv error: recv got EOF from 127.24.71.194:60333 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 09:58:45 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:45 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:45.676492 5873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:45.671079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:33889)
0808 09:58:45.671246 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:45.671269 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:45.671387 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:45.671622 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:45.671623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:45.671859 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:45.671913 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:45.671915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:45.672662 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:45.672664 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:45.673208 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:45.673210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:45.673624 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:45.673625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:45.673695 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:45.674266 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:45.674272 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:45.676384 (+ 2112us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":101,"threads_started":1}
W20260808 09:58:45.676550 5870 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:45.671179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:33889 (local address 127.24.71.254:43131)
0808 09:58:45.671285 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:45.671287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:45.671370 (+ 83us) server_negotiation.cc:407] Connection header received
0808 09:58:45.671507 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:45.671508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:45.671525 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:45.671612 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:45.672023 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:45.672549 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:45.673318 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:45.673522 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:45.673621 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:45.676478 (+ 2857us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:33889: BlockingRecv error: recv got EOF from 127.24.71.195:33889 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 09:58:46 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:46 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:46.424044 5874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:46.418843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:60429)
0808 09:58:46.419039 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:46.419050 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:46.419110 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:46.419318 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:46.419319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:46.419601 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:46.419679 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:46.419683 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:46.420543 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:46.420544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:46.421101 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:46.421103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:46.421453 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:46.421454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:46.421497 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:46.422052 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:46.422060 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:46.423983 (+ 1923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":141,"threads_started":1}
W20260808 09:58:46.424216 5876 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:46.419009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:60429 (local address 127.24.71.254:43131)
0808 09:58:46.419160 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:46.419163 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:46.419172 (+ 9us) server_negotiation.cc:407] Connection header received
0808 09:58:46.419197 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:46.419197 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:46.419207 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:46.419305 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:46.419774 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:46.420457 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:46.421177 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:46.421383 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:46.421435 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:46.424116 (+ 2681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:60429: BlockingRecv error: recv got EOF from 127.24.71.193:60429 (error 108)
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
Aug 08 09:58:46 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:46 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:46.542120 5877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:46.536892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:41757)
0808 09:58:46.537029 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:46.537039 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:46.537092 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:46.537285 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:46.537285 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:46.537472 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:46.537519 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:46.537522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:46.538239 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:46.538239 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:46.538782 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:46.538783 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:46.539199 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:46.539200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:46.539245 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:46.539825 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:46.539830 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:46.542048 (+ 2218us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":68,"threads_started":1}
W20260808 09:58:46.542253 5876 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:46.537006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:41757 (local address 127.24.71.254:43131)
0808 09:58:46.537111 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:46.537113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:46.537136 (+ 23us) server_negotiation.cc:407] Connection header received
0808 09:58:46.537168 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:46.537169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:46.537181 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:46.537264 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:46.537630 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:46.538157 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:46.538891 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:46.539110 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:46.539179 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:46.542163 (+ 2984us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:41757: BlockingRecv error: recv got EOF from 127.24.71.194:41757 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 09:58:46 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:46 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.195@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:46.682264 5878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:46.677130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.195:38511)
0808 09:58:46.677387 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:46.677400 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:46.677496 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:46.677651 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:46.677652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:46.677859 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:46.677908 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:46.677910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:46.678606 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:46.678607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:46.679179 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:46.679181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:46.679624 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:46.679625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:46.679691 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:46.680162 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:46.680167 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:46.682193 (+ 2026us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":115,"threads_started":1}
W20260808 09:58:46.682415 5876 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:46.677253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:38511 (local address 127.24.71.254:43131)
0808 09:58:46.677354 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:46.677357 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:46.677475 (+ 118us) server_negotiation.cc:407] Connection header received
0808 09:58:46.677557 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:46.677558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:46.677574 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:46.677645 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:46.678008 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:46.678514 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:46.679276 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:46.679535 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:46.679610 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:46.682328 (+ 2718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.195:38511: BlockingRecv error: recv got EOF from 127.24.71.195:38511 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 09:58:47 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:47 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.193@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:47.432323 5880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:47.424687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.193:39657)
0808 09:58:47.424874 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:47.424885 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:47.424934 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:47.425140 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:47.425140 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:47.425323 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:47.425372 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:47.425373 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.426421 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.426422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:47.426967 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:47.426969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.427358 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.427359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:47.427466 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:47.430424 (+ 2958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:47.430429 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:47.432246 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":125,"threads_started":1}
W20260808 09:58:47.432499 5881 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:47.424832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:39657 (local address 127.24.71.254:43131)
0808 09:58:47.424983 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:47.424985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:47.424996 (+ 11us) server_negotiation.cc:407] Connection header received
0808 09:58:47.425031 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:47.425032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:47.425049 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:47.425128 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:47.425454 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.426331 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.427051 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.427286 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.427384 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:47.432393 (+ 5009us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.193:39657: BlockingRecv error: recv got EOF from 127.24.71.193:39657 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":98,"threads_started":1}
Aug 08 09:58:47 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 09:58:47 dist-test-slave-gw5c krb5kdc[4323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.71.194@KRBTEST.COM for oryx/127.24.71.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 09:58:47.549013 5882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:47.542724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43131 (local address 127.24.71.194:45775)
0808 09:58:47.542894 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:47.542906 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:47.542966 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:47.543157 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:47.543159 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:47.543377 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:47.543523 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:47.543526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.544638 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.544639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:47.545425 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:47.545427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.545999 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.546000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:47.546108 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:47.546744 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:47.546750 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:47.548940 (+ 2190us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.71.254:43131: Server oryx/127.24.71.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":99,"threads_started":1}
W20260808 09:58:47.549222 5881 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:47.542830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:45775 (local address 127.24.71.254:43131)
0808 09:58:47.542902 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:47.542904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:47.542957 (+ 53us) server_negotiation.cc:407] Connection header received
0808 09:58:47.543022 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:47.543023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:47.543038 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:47.543121 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:47.543621 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.544537 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.545507 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.545896 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.545980 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:47.549073 (+ 3093us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.71.194:45775: BlockingRecv error: recv got EOF from 127.24.71.194:45775 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 09:58:47.600600 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 5169
I20260808 09:58:47.612893 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 5394
I20260808 09:58:47.621757 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 5590
I20260808 09:58:47.632408 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 5066
2026-08-08T09:58:47Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17804 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T09:58:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:47Z Disabled control of system clock
I20260808 09:58:47.668907 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:34933
--webserver_interface=127.24.71.254
--webserver_port=0
--builtin_ntp_servers=127.24.71.212:43269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:34933
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 09:58:47.751478 5886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:47.751690 5886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:47.751713 5886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:47.752913 5886 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:47.752957 5886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:47.752971 5886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:47.752983 5886 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:47.752996 5886 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:47.754356 5886 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:43269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:34933
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:34933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:47.754627 5886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:47.754923 5886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:47.759840 5897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:47.759856 5901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:47.760102 5886 server_base.cc:1034] running on GCE node
W20260808 09:58:47.759856 5896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:47.760452 5886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:47.760704 5886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:47.761869 5886 hybrid_clock.cc:648] HybridClock initialized: now 1786183127761855 us; error 39 us; skew 500 ppm
I20260808 09:58:47.763137 5886 webserver.cc:460] Webserver started at http://127.24.71.254:43209/ using document root <none> and password file <none>
I20260808 09:58:47.763374 5886 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:47.763487 5886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:47.763625 5886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:47.764693 5886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "5c6d43da1afe43839f109348d6880763"
format_stamp: "Formatted at 2026-08-08 09:58:47 on dist-test-slave-gw5c"
server_key: "97d306a9352555236b655e54663a16b1"
server_key_iv: "c3f186ba7635d81ff732d6d62461158f"
server_key_version: "encryptionkey@0"
I20260808 09:58:47.765079 5886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "5c6d43da1afe43839f109348d6880763"
format_stamp: "Formatted at 2026-08-08 09:58:47 on dist-test-slave-gw5c"
server_key: "97d306a9352555236b655e54663a16b1"
server_key_iv: "c3f186ba7635d81ff732d6d62461158f"
server_key_version: "encryptionkey@0"
I20260808 09:58:47.766439 5886 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:47.767258 5914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:47.767503 5886 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:47.767611 5886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "5c6d43da1afe43839f109348d6880763"
format_stamp: "Formatted at 2026-08-08 09:58:47 on dist-test-slave-gw5c"
server_key: "97d306a9352555236b655e54663a16b1"
server_key_iv: "c3f186ba7635d81ff732d6d62461158f"
server_key_version: "encryptionkey@0"
I20260808 09:58:47.767693 5886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:47.776383 5886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:47.776721 5886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:47.776880 5886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:47.781438 5886 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:34933
I20260808 09:58:47.781476 5997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:34933 every 8 connection(s)
I20260808 09:58:47.781836 5886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:47.782567 5998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:47.783715 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 5886
I20260808 09:58:47.783834 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:47.784078 24863 external_mini_cluster.cc:1428] Setting key bdf92c831f0f7f09414f747e4c103c9b
I20260808 09:58:47.786078 5998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763: Bootstrap starting.
I20260808 09:58:47.786741 5998 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:47.787062 5998 log.cc:824] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:47.787870 5998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763: No bootstrap required, opened a new log
I20260808 09:58:47.789306 5998 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6d43da1afe43839f109348d6880763" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34933 } }
I20260808 09:58:47.789470 5998 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:47.789544 5998 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c6d43da1afe43839f109348d6880763, State: Initialized, Role: FOLLOWER
I20260808 09:58:47.789731 5998 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6d43da1afe43839f109348d6880763" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34933 } }
I20260808 09:58:47.789846 5998 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:47.789896 5998 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:47.789973 5998 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:47.789981 6003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:47.784718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42770 (local address 127.24.71.254:34933)
0808 09:58:47.784939 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:47.784947 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:47.784973 (+ 26us) server_negotiation.cc:407] Connection header received
0808 09:58:47.785390 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:47.785396 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:47.785463 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:47.785613 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:47.785849 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.786760 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.787631 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.788119 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.788260 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:47.788982 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:47.788986 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:47.788987 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:47.789166 (+ 179us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:47.789198 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:47.789209 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:47.789283 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:47.789361 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 09:58:47.789445 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":88,"threads_started":1}
I20260808 09:58:47.790757 5998 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6d43da1afe43839f109348d6880763" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34933 } }
I20260808 09:58:47.790884 5998 leader_election.cc:302] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c6d43da1afe43839f109348d6880763; no voters:
I20260808 09:58:47.791062 5998 leader_election.cc:288] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:47.791096 6006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:47.791294 6006 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [term 1 LEADER]: Becoming Leader. State: Replica: 5c6d43da1afe43839f109348d6880763, State: Running, Role: LEADER
I20260808 09:58:47.791364 5998 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:47.791534 6006 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6d43da1afe43839f109348d6880763" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34933 } }
I20260808 09:58:47.791908 6007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c6d43da1afe43839f109348d6880763" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6d43da1afe43839f109348d6880763" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34933 } } }
I20260808 09:58:47.791908 6008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c6d43da1afe43839f109348d6880763. Latest consensus state: current_term: 1 leader_uuid: "5c6d43da1afe43839f109348d6880763" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6d43da1afe43839f109348d6880763" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34933 } } }
I20260808 09:58:47.792059 6008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:47.792255 6007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:47.792325 6017 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:47.792902 6017 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:47.794480 6017 catalog_manager.cc:1347] Generated new cluster ID: 7bfa16204afb4b34bbb856a1654d922f
I20260808 09:58:47.794539 6017 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:47.800027 6017 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:47.800709 6017 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:47.810700 6017 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c6d43da1afe43839f109348d6880763: Generated new TSK 0
I20260808 09:58:47.810914 6017 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 09:58:47.815217 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:34933
--builtin_ntp_servers=127.24.71.212:43269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 09:58:47.901212 6033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:47.901492 6033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:47.901533 6033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:47.902724 6033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:47.902794 6033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:47.902839 6033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:47.904302 6033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:43269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:34933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:47.904577 6033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:47.904891 6033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:47.910804 6045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:47.910792 6048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:47.910993 6033 server_base.cc:1034] running on GCE node
W20260808 09:58:47.911203 6041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:47.911451 6033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:47.911727 6033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:47.912904 6033 hybrid_clock.cc:648] HybridClock initialized: now 1786183127912892 us; error 28 us; skew 500 ppm
I20260808 09:58:47.914188 6033 webserver.cc:460] Webserver started at http://127.24.71.193:34427/ using document root <none> and password file <none>
I20260808 09:58:47.914439 6033 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:47.914510 6033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:47.914651 6033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:47.915844 6033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "15999895e1fb4d4ab4f077bee7b49aec"
format_stamp: "Formatted at 2026-08-08 09:58:47 on dist-test-slave-gw5c"
server_key: "4ec3e0d18ece20e3082083c0590d174e"
server_key_iv: "ce9724e7f1cc1d454b844800d8d8dfb3"
server_key_version: "encryptionkey@0"
I20260808 09:58:47.916208 6033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "15999895e1fb4d4ab4f077bee7b49aec"
format_stamp: "Formatted at 2026-08-08 09:58:47 on dist-test-slave-gw5c"
server_key: "4ec3e0d18ece20e3082083c0590d174e"
server_key_iv: "ce9724e7f1cc1d454b844800d8d8dfb3"
server_key_version: "encryptionkey@0"
I20260808 09:58:47.917563 6033 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 09:58:47.918344 6055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:47.918494 6033 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:47.918584 6033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "15999895e1fb4d4ab4f077bee7b49aec"
format_stamp: "Formatted at 2026-08-08 09:58:47 on dist-test-slave-gw5c"
server_key: "4ec3e0d18ece20e3082083c0590d174e"
server_key_iv: "ce9724e7f1cc1d454b844800d8d8dfb3"
server_key_version: "encryptionkey@0"
I20260808 09:58:47.918655 6033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:47.935142 6033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:47.935561 6033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:47.935725 6033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:47.935992 6033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:47.936359 6033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:47.936395 6033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:47.936419 6033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:47.936461 6033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:47.942517 6033 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:43977
I20260808 09:58:47.942577 6224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:43977 every 8 connection(s)
I20260808 09:58:47.942945 6033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 09:58:47.948230 6003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:47.943749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:45979 (local address 127.24.71.254:34933)
0808 09:58:47.943800 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:47.943802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:47.944052 (+ 250us) server_negotiation.cc:407] Connection header received
0808 09:58:47.944545 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:47.944546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:47.944557 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:47.944621 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:47.945273 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.945780 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.946810 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.946999 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.947051 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:47.948007 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:47.948008 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:47.948008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:47.948013 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:47.948024 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:47.948028 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:47.948066 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:47.948136 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 09:58:47.948164 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 09:58:47.948472 6228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:47.943712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:34933 (local address 127.24.71.193:45979)
0808 09:58:47.943918 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:47.943967 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:47.944461 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:47.944676 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:47.944680 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:47.944688 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:47.945198 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:47.945203 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.945909 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.945910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:47.946721 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:47.946723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:47.947080 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:47.947081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:47.947199 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:47.947872 (+ 673us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:47.947872 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:47.947903 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:47.947926 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:47.948068 (+ 142us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:47.948070 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:47.948073 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:47.948124 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 09:58:47.948209 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":101,"threads_started":1}
I20260808 09:58:47.949031 6225 heartbeater.cc:347] Connected to a master server at 127.24.71.254:34933
I20260808 09:58:47.949146 6225 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:47.949352 6225 heartbeater.cc:511] Master 127.24.71.254:34933 requested a full tablet report, sending...
I20260808 09:58:47.949911 5938 ts_manager.cc:194] Registered new tserver with Master: 15999895e1fb4d4ab4f077bee7b49aec (127.24.71.193:43977)
I20260808 09:58:47.950567 5938 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.71.193:45979
I20260808 09:58:47.951623 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 6033
I20260808 09:58:47.951706 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:58:47.951884 24863 external_mini_cluster.cc:1428] Setting key 64e9cafba4e40ac9220aa9ea73273d64
I20260808 09:58:47.952692 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:34933
--builtin_ntp_servers=127.24.71.212:43269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 09:58:48.036818 6229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:48.037075 6229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:48.037112 6229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:48.038259 6229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:48.038328 6229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:48.038368 6229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:48.039831 6229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:43269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:34933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:48.040102 6229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:48.040414 6229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:48.045540 6250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:48.045604 6229 server_base.cc:1034] running on GCE node
W20260808 09:58:48.045547 6242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:48.045548 6241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:48.046000 6229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:48.046209 6229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:48.047343 6229 hybrid_clock.cc:648] HybridClock initialized: now 1786183128047331 us; error 37 us; skew 500 ppm
I20260808 09:58:48.048668 6229 webserver.cc:460] Webserver started at http://127.24.71.194:38961/ using document root <none> and password file <none>
I20260808 09:58:48.048935 6229 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:48.049006 6229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:48.049149 6229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:48.050292 6229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "177aa404a6d8455b9c262218b8d8e645"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "8b1a24b00c2ee887c2cf404773c245cf"
server_key_iv: "68e6123159a523ca52e9a7ed82ab0589"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.050665 6229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "177aa404a6d8455b9c262218b8d8e645"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "8b1a24b00c2ee887c2cf404773c245cf"
server_key_iv: "68e6123159a523ca52e9a7ed82ab0589"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.052088 6229 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:48.052845 6257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.053005 6229 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:48.053112 6229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "177aa404a6d8455b9c262218b8d8e645"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "8b1a24b00c2ee887c2cf404773c245cf"
server_key_iv: "68e6123159a523ca52e9a7ed82ab0589"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.053188 6229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:48.071354 6229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:48.071801 6229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:48.071954 6229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:48.072202 6229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:48.072546 6229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:48.072597 6229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.072641 6229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:48.072672 6229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.078408 6229 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:41037
I20260808 09:58:48.078454 6438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:41037 every 8 connection(s)
I20260808 09:58:48.078850 6229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:58:48.084106 6003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:48.079695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:44259 (local address 127.24.71.254:34933)
0808 09:58:48.079768 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:48.079772 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:48.080032 (+ 260us) server_negotiation.cc:407] Connection header received
0808 09:58:48.080533 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:48.080535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:48.080546 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:48.080605 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:48.081299 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:48.081798 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:48.082757 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:48.082941 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:48.082994 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:48.083885 (+ 891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:48.083887 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:48.083887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:48.083892 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:48.083908 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:48.083913 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:48.083960 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:48.084019 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 09:58:48.084043 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 09:58:48.084303 6442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:48.079695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:34933 (local address 127.24.71.194:44259)
0808 09:58:48.079905 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:48.079941 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:48.080429 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:48.080658 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:48.080661 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:48.080669 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:48.081182 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:48.081187 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:48.081886 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:48.081886 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:48.082684 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:48.082687 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:48.083016 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:48.083017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:48.083128 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:48.083751 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:48.083752 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:48.083781 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:48.083804 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:48.083960 (+ 156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:48.083962 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:48.083965 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:48.084013 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 09:58:48.084089 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":89,"threads_started":1}
I20260808 09:58:48.084867 6440 heartbeater.cc:347] Connected to a master server at 127.24.71.254:34933
I20260808 09:58:48.084980 6440 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:48.085170 6440 heartbeater.cc:511] Master 127.24.71.254:34933 requested a full tablet report, sending...
I20260808 09:58:48.085547 5938 ts_manager.cc:194] Registered new tserver with Master: 177aa404a6d8455b9c262218b8d8e645 (127.24.71.194:41037)
I20260808 09:58:48.085886 5938 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.71.194:44259
I20260808 09:58:48.088472 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 6229
I20260808 09:58:48.088552 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:58:48.088721 24863 external_mini_cluster.cc:1428] Setting key a1300e9a2604c2ade8e56a6d59e86fe5
I20260808 09:58:48.089691 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:34933
--builtin_ntp_servers=127.24.71.212:43269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 09:58:48.173637 6443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:48.173853 6443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:48.173877 6443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:48.175011 6443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:48.175053 6443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:48.175113 6443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:48.176551 6443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:43269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:34933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:48.176766 6443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:48.177037 6443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:48.182010 6449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:48.182013 6451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:48.182161 6443 server_base.cc:1034] running on GCE node
W20260808 09:58:48.182317 6448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:48.182519 6443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:48.182729 6443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:48.183918 6443 hybrid_clock.cc:648] HybridClock initialized: now 1786183128183897 us; error 36 us; skew 500 ppm
I20260808 09:58:48.185340 6443 webserver.cc:460] Webserver started at http://127.24.71.195:39443/ using document root <none> and password file <none>
I20260808 09:58:48.185600 6443 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:48.185649 6443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:48.185827 6443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:48.186928 6443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "73d76b4463e14ffc8c507cf9a1a97a1d"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "ae0b282df5b63abf909b6610974e1ab1"
server_key_iv: "d44578ea7c5405e233a3f0363f5ac0a6"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.187338 6443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "73d76b4463e14ffc8c507cf9a1a97a1d"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "ae0b282df5b63abf909b6610974e1ab1"
server_key_iv: "d44578ea7c5405e233a3f0363f5ac0a6"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.188757 6443 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:48.189462 6457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.189631 6443 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:48.189797 6443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "73d76b4463e14ffc8c507cf9a1a97a1d"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "ae0b282df5b63abf909b6610974e1ab1"
server_key_iv: "d44578ea7c5405e233a3f0363f5ac0a6"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.189873 6443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:48.206115 6443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:48.206491 6443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:48.206652 6443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:48.206902 6443 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:48.207242 6443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:48.207301 6443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.207343 6443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:48.207387 6443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.213462 6443 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:36439
I20260808 09:58:48.213539 6635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:36439 every 8 connection(s)
I20260808 09:58:48.213891 6443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:58:48.215840 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 6443
I20260808 09:58:48.215958 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:58:48.216149 24863 external_mini_cluster.cc:1428] Setting key 84210207df9c1095bab14c3abd64309b
I20260808 09:58:48.219416 6003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:48.214627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:48209 (local address 127.24.71.254:34933)
0808 09:58:48.214678 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:48.214680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:48.214947 (+ 267us) server_negotiation.cc:407] Connection header received
0808 09:58:48.215487 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:48.215488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:48.215498 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:48.215556 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:48.216333 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:48.217003 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:48.218013 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:48.218227 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:48.218302 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:48.219114 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:48.219116 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:48.219116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:48.219121 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:48.219136 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:48.219140 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:48.219189 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:48.219279 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 09:58:48.219307 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 09:58:48.219622 6641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:48.214587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:34933 (local address 127.24.71.195:48209)
0808 09:58:48.214795 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:48.214851 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:48.215341 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:48.215618 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:48.215621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:48.215629 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:48.216198 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:48.216203 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:48.217105 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:48.217106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:48.217914 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:48.217916 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:48.218310 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:48.218311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:48.218459 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:48.218964 (+ 505us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:48.218964 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:48.219001 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:48.219022 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:48.219188 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:48.219193 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:48.219196 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:48.219280 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 09:58:48.219382 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":89,"threads_started":1}
I20260808 09:58:48.220094 6637 heartbeater.cc:347] Connected to a master server at 127.24.71.254:34933
I20260808 09:58:48.220202 6637 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:48.220389 6637 heartbeater.cc:511] Master 127.24.71.254:34933 requested a full tablet report, sending...
I20260808 09:58:48.220758 5938 ts_manager.cc:194] Registered new tserver with Master: 73d76b4463e14ffc8c507cf9a1a97a1d (127.24.71.195:36439)
I20260808 09:58:48.221123 5938 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.71.195:48209
I20260808 09:58:48.228085 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 09:58:48.230041 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 6033
W20260808 09:58:48.230043 6003 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:48.229486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42786 (local address 127.24.71.254:34933)
0808 09:58:48.229554 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:48.229557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:48.229692 (+ 135us) server_negotiation.cc:407] Connection header received
0808 09:58:48.229730 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:48.229731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:48.229740 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:48.229785 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:48.229960 (+ 175us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42786: BlockingRecv error: recv got EOF from 127.0.0.1:42786 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 09:58:48.242955 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 6229
I20260808 09:58:48.250021 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 6443
I20260808 09:58:48.260624 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 5886
2026-08-08T09:58:48Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (629 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T09:58:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:48Z Disabled control of system clock
I20260808 09:58:48.297750 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33881
--webserver_interface=127.24.71.254
--webserver_port=0
--builtin_ntp_servers=127.24.71.212:43801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:33881
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 09:58:48.382027 6650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:48.382241 6650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:48.382262 6650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:48.383513 6650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:48.383558 6650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:48.383572 6650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:48.383585 6650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:48.383597 6650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:48.384990 6650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:43801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:33881
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:48.385264 6650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:48.385572 6650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:48.390566 6660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:48.390655 6650 server_base.cc:1034] running on GCE node
W20260808 09:58:48.390575 6663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:48.390728 6661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:48.391060 6650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:48.391438 6650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:48.392602 6650 hybrid_clock.cc:648] HybridClock initialized: now 1786183128392584 us; error 38 us; skew 500 ppm
I20260808 09:58:48.394029 6650 webserver.cc:460] Webserver started at http://127.24.71.254:35397/ using document root <none> and password file <none>
I20260808 09:58:48.394315 6650 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:48.394369 6650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:48.394500 6650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:48.395665 6650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "ba20dcd236dc4aca9431c9a8a2959386"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "1457b30c027f5f5015d7b19340fc3c5b"
server_key_iv: "dc98207f96d8e8c6daa15d91290bd1f3"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.396028 6650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "ba20dcd236dc4aca9431c9a8a2959386"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "1457b30c027f5f5015d7b19340fc3c5b"
server_key_iv: "dc98207f96d8e8c6daa15d91290bd1f3"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.397372 6650 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 09:58:48.398161 6674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.398345 6650 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 09:58:48.398435 6650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "ba20dcd236dc4aca9431c9a8a2959386"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "1457b30c027f5f5015d7b19340fc3c5b"
server_key_iv: "dc98207f96d8e8c6daa15d91290bd1f3"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.398509 6650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:48.401954 6650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:48.402249 6650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:48.402379 6650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:48.406409 6650 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:33881
I20260808 09:58:48.406464 6761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:33881 every 8 connection(s)
I20260808 09:58:48.406777 6650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:48.407503 6763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:48.410280 6763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386: Bootstrap starting.
I20260808 09:58:48.410823 6763 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:48.411082 6763 log.cc:824] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:48.411844 6763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386: No bootstrap required, opened a new log
I20260808 09:58:48.412420 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 6650
I20260808 09:58:48.412533 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:48.412743 24863 external_mini_cluster.cc:1428] Setting key 3e7d99262855757a3ffd9bb96ad61671
I20260808 09:58:48.414031 6763 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba20dcd236dc4aca9431c9a8a2959386" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33881 } }
I20260808 09:58:48.414208 6763 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:48.414247 6763 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba20dcd236dc4aca9431c9a8a2959386, State: Initialized, Role: FOLLOWER
I20260808 09:58:48.414429 6763 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba20dcd236dc4aca9431c9a8a2959386" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33881 } }
I20260808 09:58:48.414522 6763 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:48.414587 6763 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:48.414638 6763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:48.415347 6763 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba20dcd236dc4aca9431c9a8a2959386" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33881 } }
I20260808 09:58:48.415484 6763 leader_election.cc:302] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba20dcd236dc4aca9431c9a8a2959386; no voters:
I20260808 09:58:48.415530 6770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:48.413314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52364 (local address 127.24.71.254:33881)
0808 09:58:48.413584 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:48.413593 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:48.413631 (+ 38us) server_negotiation.cc:407] Connection header received
0808 09:58:48.413984 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:48.413993 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:48.414055 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:48.414210 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:48.415000 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:48.415004 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:48.415004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:48.415009 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:48.415056 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:48.415072 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:48.415151 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:48.415211 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 09:58:48.415269 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":126,"threads_started":1}
I20260808 09:58:48.415648 6763 leader_election.cc:288] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:48.415946 6763 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:48.415998 6771 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:48.416208 6771 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [term 1 LEADER]: Becoming Leader. State: Replica: ba20dcd236dc4aca9431c9a8a2959386, State: Running, Role: LEADER
I20260808 09:58:48.416389 6771 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba20dcd236dc4aca9431c9a8a2959386" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33881 } }
I20260808 09:58:48.416867 6774 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba20dcd236dc4aca9431c9a8a2959386" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba20dcd236dc4aca9431c9a8a2959386" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33881 } } }
I20260808 09:58:48.416903 6772 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba20dcd236dc4aca9431c9a8a2959386. Latest consensus state: current_term: 1 leader_uuid: "ba20dcd236dc4aca9431c9a8a2959386" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba20dcd236dc4aca9431c9a8a2959386" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33881 } } }
I20260808 09:58:48.416975 6774 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:48.416983 6772 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:48.417199 6794 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:48.417831 6794 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:58:48.419361 6794 catalog_manager.cc:1347] Generated new cluster ID: 21ac2ca5e7ce4c138deb65e38d9038ee
I20260808 09:58:48.419448 6794 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:48.431056 6794 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:48.431270 6794 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:48.445212 6794 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba20dcd236dc4aca9431c9a8a2959386: Generated new TSK 0
I20260808 09:58:48.445569 6794 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 09:58:48.456954 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33881
--builtin_ntp_servers=127.24.71.212:43801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 09:58:48.561578 6807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:48.561846 6807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:48.561888 6807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:48.563100 6807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:48.563165 6807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:48.563206 6807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:48.564893 6807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:43801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:48.565272 6807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:48.565639 6807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:48.570880 6818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:48.570863 6815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:48.570888 6821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:48.571442 6807 server_base.cc:1034] running on GCE node
I20260808 09:58:48.571683 6807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:48.572085 6807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:48.573314 6807 hybrid_clock.cc:648] HybridClock initialized: now 1786183128573269 us; error 67 us; skew 500 ppm
I20260808 09:58:48.574694 6807 webserver.cc:460] Webserver started at http://127.24.71.193:33327/ using document root <none> and password file <none>
I20260808 09:58:48.574968 6807 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:48.575042 6807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:48.575189 6807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:48.576421 6807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "27c323f3391949d18b41155aa1d0f3ca"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "b6775d4faeaa4efb918add79b42f6163"
server_key_iv: "f3f056a2d0604e3800aa8203651793d0"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.576797 6807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "27c323f3391949d18b41155aa1d0f3ca"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "b6775d4faeaa4efb918add79b42f6163"
server_key_iv: "f3f056a2d0604e3800aa8203651793d0"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.578179 6807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 09:58:48.578904 6835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.579078 6807 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:48.579178 6807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "27c323f3391949d18b41155aa1d0f3ca"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "b6775d4faeaa4efb918add79b42f6163"
server_key_iv: "f3f056a2d0604e3800aa8203651793d0"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.579262 6807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:48.582587 6807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:48.582854 6807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:48.582995 6807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:48.583206 6807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:48.583600 6807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:48.583653 6807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.583693 6807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:48.583721 6807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.589614 6807 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:39741
I20260808 09:58:48.589679 7024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:39741 every 8 connection(s)
I20260808 09:58:48.590008 6807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 09:58:48.593237 6770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:48.590796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:55315 (local address 127.24.71.254:33881)
0808 09:58:48.590859 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:48.590861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:48.591114 (+ 253us) server_negotiation.cc:407] Connection header received
0808 09:58:48.591743 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:48.591745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:48.591754 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:48.591815 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:48.592948 (+ 1133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:48.592950 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:48.592950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:48.592955 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:48.592971 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:48.592976 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:48.593057 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:48.593146 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 09:58:48.593166 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 09:58:48.593461 7028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:48.590775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33881 (local address 127.24.71.193:55315)
0808 09:58:48.590967 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:48.591018 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:48.591623 (+ 605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:48.591887 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:48.591891 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:48.591900 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:48.592798 (+ 898us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:48.592799 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:48.592826 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:48.592855 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:48.593057 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:48.593065 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:48.593067 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 09:58:48.593158 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 09:58:48.593222 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":104,"threads_started":1}
I20260808 09:58:48.593732 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 6807
I20260808 09:58:48.593847 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:58:48.593991 7025 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33881
I20260808 09:58:48.594063 24863 external_mini_cluster.cc:1428] Setting key 9c5d7765848064d1bba0f7539e054b49
I20260808 09:58:48.594103 7025 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:48.594252 7025 heartbeater.cc:511] Master 127.24.71.254:33881 requested a full tablet report, sending...
I20260808 09:58:48.594810 6701 ts_manager.cc:194] Registered new tserver with Master: 27c323f3391949d18b41155aa1d0f3ca (127.24.71.193:39741)
I20260808 09:58:48.595062 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33881
--builtin_ntp_servers=127.24.71.212:43801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 09:58:48.679498 7029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:48.679719 7029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:48.679742 7029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:48.680935 7029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:48.680974 7029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:48.681000 7029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:48.682421 7029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:43801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:48.682663 7029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:48.682981 7029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 09:58:48.688035 7029 server_base.cc:1034] running on GCE node
W20260808 09:58:48.688006 7041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:48.688005 7036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:48.688054 7035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:48.688539 7029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:48.688788 7029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:48.689965 7029 hybrid_clock.cc:648] HybridClock initialized: now 1786183128689969 us; error 42 us; skew 500 ppm
I20260808 09:58:48.691205 7029 webserver.cc:460] Webserver started at http://127.24.71.194:33631/ using document root <none> and password file <none>
I20260808 09:58:48.691550 7029 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:48.691622 7029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:48.691761 7029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:48.692840 7029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "caaeeb3a66ab465f80e17777425e9923"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "a445477fa77621a3f541f2aca4b9df45"
server_key_iv: "b82e19c276488f2ab191eca7c645f9aa"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.693209 7029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "caaeeb3a66ab465f80e17777425e9923"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "a445477fa77621a3f541f2aca4b9df45"
server_key_iv: "b82e19c276488f2ab191eca7c645f9aa"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.694528 7029 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:48.695211 7047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.695444 7029 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:48.695545 7029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "caaeeb3a66ab465f80e17777425e9923"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "a445477fa77621a3f541f2aca4b9df45"
server_key_iv: "b82e19c276488f2ab191eca7c645f9aa"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.695626 7029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:48.698982 7029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:48.699260 7029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:48.699432 7029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:48.699662 7029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:48.699985 7029 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:48.700037 7029 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.700078 7029 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:48.700105 7029 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.706094 7029 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:35699
I20260808 09:58:48.706136 7217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:35699 every 8 connection(s)
I20260808 09:58:48.706472 7029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:58:48.709630 6770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:48.707222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:58563 (local address 127.24.71.254:33881)
0808 09:58:48.707296 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:48.707299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:48.707618 (+ 319us) server_negotiation.cc:407] Connection header received
0808 09:58:48.708085 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:48.708086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:48.708092 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:48.708150 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:48.709395 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:48.709396 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:48.709396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:48.709401 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:48.709417 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:48.709421 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:48.709482 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:48.709556 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 09:58:48.709570 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 09:58:48.709839 7220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:48.707215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33881 (local address 127.24.71.194:58563)
0808 09:58:48.707482 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:48.707525 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:48.707990 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:48.708204 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:48.708207 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:48.708215 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:48.709202 (+ 987us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:48.709202 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:48.709232 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:48.709262 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:48.709488 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:48.709493 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:48.709495 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 09:58:48.709555 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 09:58:48.709605 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":118,"threads_started":1}
I20260808 09:58:48.710275 7218 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33881
I20260808 09:58:48.710376 7218 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:48.710553 7218 heartbeater.cc:511] Master 127.24.71.254:33881 requested a full tablet report, sending...
I20260808 09:58:48.710629 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 7029
I20260808 09:58:48.710727 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:58:48.710939 24863 external_mini_cluster.cc:1428] Setting key 8e6f6d558d5c0b89df6bd8868e93f56f
I20260808 09:58:48.710968 6701 ts_manager.cc:194] Registered new tserver with Master: caaeeb3a66ab465f80e17777425e9923 (127.24.71.194:35699)
I20260808 09:58:48.712030 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33881
--builtin_ntp_servers=127.24.71.212:43801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 09:58:48.795279 7221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:48.795568 7221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:48.795610 7221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:48.796823 7221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:48.796890 7221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:48.796933 7221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:48.798429 7221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:43801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:48.798703 7221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:48.799023 7221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:48.804097 7233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:48.804101 7235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:48.804104 7228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:48.804435 7221 server_base.cc:1034] running on GCE node
I20260808 09:58:48.804663 7221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:48.804884 7221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:48.806044 7221 hybrid_clock.cc:648] HybridClock initialized: now 1786183128806028 us; error 31 us; skew 500 ppm
I20260808 09:58:48.807627 7221 webserver.cc:460] Webserver started at http://127.24.71.195:45017/ using document root <none> and password file <none>
I20260808 09:58:48.807897 7221 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:48.807951 7221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:48.808132 7221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:48.809334 7221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "7778cbbb7cce4b6697d6aaefe4dc6905"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "0a9f9175396941621829bda1955e4653"
server_key_iv: "5649b2ca5c94d2cac2f7eae7401ca1e2"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.809711 7221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "7778cbbb7cce4b6697d6aaefe4dc6905"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "0a9f9175396941621829bda1955e4653"
server_key_iv: "5649b2ca5c94d2cac2f7eae7401ca1e2"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.811084 7221 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 09:58:48.811903 7245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.812081 7221 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.812175 7221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "7778cbbb7cce4b6697d6aaefe4dc6905"
format_stamp: "Formatted at 2026-08-08 09:58:48 on dist-test-slave-gw5c"
server_key: "0a9f9175396941621829bda1955e4653"
server_key_iv: "5649b2ca5c94d2cac2f7eae7401ca1e2"
server_key_version: "encryptionkey@0"
I20260808 09:58:48.812256 7221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:48.815773 7221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:48.816042 7221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:48.816215 7221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:48.816473 7221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:48.816823 7221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:48.816861 7221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.816902 7221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:48.816933 7221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:48.823191 7221 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:41227
I20260808 09:58:48.823278 7423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:41227 every 8 connection(s)
I20260808 09:58:48.823649 7221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:58:48.826599 6770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:48.824442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:37079 (local address 127.24.71.254:33881)
0808 09:58:48.824507 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:48.824509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:48.824733 (+ 224us) server_negotiation.cc:407] Connection header received
0808 09:58:48.825175 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:48.825176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:48.825183 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:48.825260 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:48.826384 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:48.826385 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:48.826385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 09:58:48.826390 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:48.826406 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 09:58:48.826411 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:48.826474 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:48.826531 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 09:58:48.826545 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 09:58:48.826800 7428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:48.824425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33881 (local address 127.24.71.195:37079)
0808 09:58:48.824600 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:48.824634 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:48.825088 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:48.825310 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:48.825313 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:48.825321 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:48.826224 (+ 903us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 09:58:48.826224 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:48.826253 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 09:58:48.826281 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:48.826473 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:48.826475 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:48.826477 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 09:58:48.826530 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 09:58:48.826577 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":90,"threads_started":1}
I20260808 09:58:48.827349 7426 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33881
I20260808 09:58:48.827481 7426 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:48.827610 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 7221
I20260808 09:58:48.827633 7426 heartbeater.cc:511] Master 127.24.71.254:33881 requested a full tablet report, sending...
I20260808 09:58:48.827715 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:58:48.827975 24863 external_mini_cluster.cc:1428] Setting key 20b5bb5f13436b483203978bbf746c79
I20260808 09:58:48.828020 6701 ts_manager.cc:194] Registered new tserver with Master: 7778cbbb7cce4b6697d6aaefe4dc6905 (127.24.71.195:41227)
I20260808 09:58:48.828866 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 09:58:48.830653 6770 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 09:58:48.830155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52370 (local address 127.24.71.254:33881)
0808 09:58:48.830193 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:48.830195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:48.830317 (+ 122us) server_negotiation.cc:407] Connection header received
0808 09:58:48.830398 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:48.830399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:48.830404 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:48.830460 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:48.830578 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52370: BlockingRecv error: recv got EOF from 127.0.0.1:52370 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 09:58:48.830742 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 6807
I20260808 09:58:48.852500 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 7029
I20260808 09:58:48.864471 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 7221
I20260808 09:58:48.874935 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 6650
2026-08-08T09:58:48Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (611 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:58:48 dist-test-slave-gw5c krb5kdc[7439](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:58:48 dist-test-slave-gw5c krb5kdc[7439](info): set up 2 sockets
Aug 08 09:58:48 dist-test-slave-gw5c krb5kdc[7439](info): commencing operation
krb5kdc: starting...
W20260808 09:58:50.127074 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:58:50 dist-test-slave-gw5c krb5kdc[7439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:58:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:58:50.250630 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:42431
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:41657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:42431
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:50.333787 7456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:50.334076 7456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:50.334117 7456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:50.335327 7456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:58:50.335407 7456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:50.335453 7456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:50.335475 7456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:58:50.335505 7456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:58:50.337030 7456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:42431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:42431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:50.337332 7456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:50.337580 7456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:50.342710 7469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:50.342813 7456 server_base.cc:1034] running on GCE node
W20260808 09:58:50.342671 7464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:50.342867 7465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:50.343299 7456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:50.343621 7456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:50.344805 7456 hybrid_clock.cc:648] HybridClock initialized: now 1786183130344802 us; error 40 us; skew 500 ppm
Aug 08 09:58:50 dist-test-slave-gw5c krb5kdc[7439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183130, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:50.347294 7456 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:58:50.347783 7456 webserver.cc:460] Webserver started at http://127.24.71.254:33847/ using document root <none> and password file <none>
I20260808 09:58:50.347980 7456 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:50.348022 7456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:50.348114 7456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:50.349148 7456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "b0e2935583654d2db0374dfc39bf4446"
format_stamp: "Formatted at 2026-08-08 09:58:50 on dist-test-slave-gw5c"
server_key: "3e6088ca799f8961885f2ede24787649"
server_key_iv: "6f5c4e9485af727bf14e9be9ff777a1b"
server_key_version: "encryptionkey@0"
I20260808 09:58:50.349473 7456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "b0e2935583654d2db0374dfc39bf4446"
format_stamp: "Formatted at 2026-08-08 09:58:50 on dist-test-slave-gw5c"
server_key: "3e6088ca799f8961885f2ede24787649"
server_key_iv: "6f5c4e9485af727bf14e9be9ff777a1b"
server_key_version: "encryptionkey@0"
I20260808 09:58:50.350798 7456 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 09:58:50.351610 7486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:50.351783 7456 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 09:58:50.351889 7456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "b0e2935583654d2db0374dfc39bf4446"
format_stamp: "Formatted at 2026-08-08 09:58:50 on dist-test-slave-gw5c"
server_key: "3e6088ca799f8961885f2ede24787649"
server_key_iv: "6f5c4e9485af727bf14e9be9ff777a1b"
server_key_version: "encryptionkey@0"
I20260808 09:58:50.351964 7456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:50.364871 7456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:50.366850 7456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:50.367027 7456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:50.371524 7456 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:42431
I20260808 09:58:50.371577 7561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:42431 every 8 connection(s)
I20260808 09:58:50.371964 7456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:58:50.373003 7562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:50.375577 7562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446: Bootstrap starting.
I20260808 09:58:50.375861 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 7456
I20260808 09:58:50.375969 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:58:50.376163 24863 external_mini_cluster.cc:1428] Setting key 144aa2e053b5a34ba27504f40e525c63
I20260808 09:58:50.376258 7562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:50.376825 7562 log.cc:824] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:50.377699 7562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446: No bootstrap required, opened a new log
I20260808 09:58:50.380120 7562 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e2935583654d2db0374dfc39bf4446" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42431 } }
I20260808 09:58:50.380260 7562 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:50.380285 7562 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0e2935583654d2db0374dfc39bf4446, State: Initialized, Role: FOLLOWER
I20260808 09:58:50.380434 7562 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e2935583654d2db0374dfc39bf4446" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42431 } }
I20260808 09:58:50.380530 7562 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:58:50.380573 7562 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:58:50.380621 7562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:50.381181 7562 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e2935583654d2db0374dfc39bf4446" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42431 } }
I20260808 09:58:50.381304 7562 leader_election.cc:302] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0e2935583654d2db0374dfc39bf4446; no voters:
I20260808 09:58:50.381506 7562 leader_election.cc:288] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:58:50.381705 7569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:50.381786 7562 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:58:50.381842 7569 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [term 1 LEADER]: Becoming Leader. State: Replica: b0e2935583654d2db0374dfc39bf4446, State: Running, Role: LEADER
I20260808 09:58:50.381958 7569 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e2935583654d2db0374dfc39bf4446" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42431 } }
I20260808 09:58:50.382335 7569 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0e2935583654d2db0374dfc39bf4446. Latest consensus state: current_term: 1 leader_uuid: "b0e2935583654d2db0374dfc39bf4446" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e2935583654d2db0374dfc39bf4446" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42431 } } }
I20260808 09:58:50.382350 7568 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0e2935583654d2db0374dfc39bf4446" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e2935583654d2db0374dfc39bf4446" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42431 } } }
I20260808 09:58:50.382431 7569 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:50.382485 7568 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446 [sys.catalog]: This master's current role is: LEADER
I20260808 09:58:50.382699 7580 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:58:50.383337 7580 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 09:58:50 dist-test-slave-gw5c krb5kdc[7439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:50.385044 7580 catalog_manager.cc:1347] Generated new cluster ID: 4752dc18174449bd998158af3dc8057f
I20260808 09:58:50.385100 7580 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:58:50.388240 7565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.376671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41762 (local address 127.24.71.254:42431)
0808 09:58:50.376843 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:50.376852 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:50.376886 (+ 34us) server_negotiation.cc:407] Connection header received
0808 09:58:50.377465 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:50.377475 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:50.377540 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:50.377699 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:50.378338 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.379845 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.380733 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.381146 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.381268 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.384738 (+ 3470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:50.384742 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:50.384742 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:50.384755 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:50.386474 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:50.386857 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:50.386860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:50.386861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:50.386959 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:50.387168 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:50.387169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:50.387169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:50.387459 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:50.387611 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:50.387831 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 09:58:50.388080 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
I20260808 09:58:50.405628 7580 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:58:50.406404 7580 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:58:50.413053 7580 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446: Generated new TSK 0
I20260808 09:58:50.413262 7580 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 09:58:50.444458 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:42431
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:41657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:50.527633 7595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:50.527846 7595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:50.527869 7595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:50.528973 7595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:50.529008 7595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:50.529034 7595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:58:50.530479 7595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:42431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:50.530665 7595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:50.530840 7595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:50.535880 7601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:50.535949 7602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:50.535934 7595 server_base.cc:1034] running on GCE node
W20260808 09:58:50.535951 7604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:50.536316 7595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:50.536530 7595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:50.537670 7595 hybrid_clock.cc:648] HybridClock initialized: now 1786183130537654 us; error 40 us; skew 500 ppm
Aug 08 09:58:50 dist-test-slave-gw5c krb5kdc[7439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183130, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:50.540323 7595 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 09:58:50.540769 7595 webserver.cc:460] Webserver started at http://127.24.71.193:42701/ using document root <none> and password file <none>
I20260808 09:58:50.540958 7595 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:50.540998 7595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:50.541087 7595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:50.542104 7595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "52c9d20c083e4081b430615fbff0bf22"
format_stamp: "Formatted at 2026-08-08 09:58:50 on dist-test-slave-gw5c"
server_key: "84365520ee27e9bd81b372da6adb221c"
server_key_iv: "0efccd9ff8453ac56b2c765fd201ca26"
server_key_version: "encryptionkey@0"
I20260808 09:58:50.542428 7595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "52c9d20c083e4081b430615fbff0bf22"
format_stamp: "Formatted at 2026-08-08 09:58:50 on dist-test-slave-gw5c"
server_key: "84365520ee27e9bd81b372da6adb221c"
server_key_iv: "0efccd9ff8453ac56b2c765fd201ca26"
server_key_version: "encryptionkey@0"
I20260808 09:58:50.543771 7595 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 09:58:50.544492 7613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:50.544657 7595 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 09:58:50.544761 7595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "52c9d20c083e4081b430615fbff0bf22"
format_stamp: "Formatted at 2026-08-08 09:58:50 on dist-test-slave-gw5c"
server_key: "84365520ee27e9bd81b372da6adb221c"
server_key_iv: "0efccd9ff8453ac56b2c765fd201ca26"
server_key_version: "encryptionkey@0"
I20260808 09:58:50.544835 7595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:50.561743 7595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:50.564201 7595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:50.564373 7595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:50.564636 7595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:50.564954 7595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:50.565007 7595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:50.565049 7595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:50.565075 7595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:50.571308 7595 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:38805
I20260808 09:58:50.571355 7792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:38805 every 8 connection(s)
I20260808 09:58:50.571713 7595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
Aug 08 09:58:50 dist-test-slave-gw5c krb5kdc[7439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183130, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:50.580080 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 7595
I20260808 09:58:50.580211 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:58:50.580406 24863 external_mini_cluster.cc:1428] Setting key ae1c7f0ac40dc397ab9958f040f10836
I20260808 09:58:50.581127 7565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.572517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:46181 (local address 127.24.71.254:42431)
0808 09:58:50.572578 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:50.572580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:50.572814 (+ 234us) server_negotiation.cc:407] Connection header received
0808 09:58:50.573302 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:50.573303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:50.573314 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:50.573354 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:50.574286 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.574786 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.575849 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.576054 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.576104 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.578288 (+ 2184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:50.578290 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:50.578290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:50.578296 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:50.579643 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:50.580100 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:50.580101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:50.580101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:50.580155 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:50.580461 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:50.580462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:50.580463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:50.580581 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:50.580651 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:50.580945 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 09:58:50.581040 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 09:58:50.581327 7796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.572515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:42431 (local address 127.24.71.193:46181)
0808 09:58:50.572691 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:50.572731 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:50.573206 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:50.573423 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:50.573426 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:50.574008 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:50.574203 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:50.574207 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.574863 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.574863 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:50.575765 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:50.575768 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.576125 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.576126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:50.576224 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.576816 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:50.576825 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:50.578170 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:50.579712 (+ 1542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:50.579718 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:50.579720 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:50.580022 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:50.580245 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:50.580246 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:50.580246 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:50.580384 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:50.580655 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:50.580663 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:50.580806 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 09:58:50.580909 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 09:58:50.581070 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
I20260808 09:58:50.581777 7793 heartbeater.cc:347] Connected to a master server at 127.24.71.254:42431
I20260808 09:58:50.581867 7793 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:50.582090 7793 heartbeater.cc:511] Master 127.24.71.254:42431 requested a full tablet report, sending...
I20260808 09:58:50.582685 7507 ts_manager.cc:194] Registered new tserver with Master: 52c9d20c083e4081b430615fbff0bf22 (127.24.71.193:38805)
I20260808 09:58:50.583469 7507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:46181
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 09:58:50.608182 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:42431
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:41657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:50.692723 7800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:50.692941 7800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:50.692965 7800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:50.694123 7800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:50.694169 7800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:50.694195 7800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:58:50.695719 7800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:42431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:50.695976 7800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:50.696208 7800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:50.701238 7811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:50.701261 7808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:50.701267 7809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:50.701508 7800 server_base.cc:1034] running on GCE node
I20260808 09:58:50.701718 7800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:50.701933 7800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:50.703109 7800 hybrid_clock.cc:648] HybridClock initialized: now 1786183130703095 us; error 26 us; skew 500 ppm
Aug 08 09:58:50 dist-test-slave-gw5c krb5kdc[7439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183130, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:50.705713 7800 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 09:58:50.706207 7800 webserver.cc:460] Webserver started at http://127.24.71.194:44373/ using document root <none> and password file <none>
I20260808 09:58:50.706452 7800 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:50.706526 7800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:50.706667 7800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:50.707769 7800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "77748924e1cd4940adc2439f9ac92e1a"
format_stamp: "Formatted at 2026-08-08 09:58:50 on dist-test-slave-gw5c"
server_key: "53667ba189519c04101ab846eb4b6352"
server_key_iv: "7402e4200d7287529bffc0cc645e06f0"
server_key_version: "encryptionkey@0"
I20260808 09:58:50.708125 7800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "77748924e1cd4940adc2439f9ac92e1a"
format_stamp: "Formatted at 2026-08-08 09:58:50 on dist-test-slave-gw5c"
server_key: "53667ba189519c04101ab846eb4b6352"
server_key_iv: "7402e4200d7287529bffc0cc645e06f0"
server_key_version: "encryptionkey@0"
I20260808 09:58:50.709475 7800 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 09:58:50.710192 7822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:50.710352 7800 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:50.710455 7800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "77748924e1cd4940adc2439f9ac92e1a"
format_stamp: "Formatted at 2026-08-08 09:58:50 on dist-test-slave-gw5c"
server_key: "53667ba189519c04101ab846eb4b6352"
server_key_iv: "7402e4200d7287529bffc0cc645e06f0"
server_key_version: "encryptionkey@0"
I20260808 09:58:50.710537 7800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:50.728493 7800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:50.730468 7800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:50.730639 7800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:50.730885 7800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:50.731213 7800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:50.731267 7800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:50.731305 7800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:50.731346 7800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:50.737497 7800 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:44397
I20260808 09:58:50.737540 8003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:44397 every 8 connection(s)
I20260808 09:58:50.737896 7800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
Aug 08 09:58:50 dist-test-slave-gw5c krb5kdc[7439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183130, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:50.744104 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 7800
I20260808 09:58:50.744227 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:58:50.744445 24863 external_mini_cluster.cc:1428] Setting key 794c518ba37bb62e3a30926cc1614978
I20260808 09:58:50.747696 7565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.738653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:50513 (local address 127.24.71.254:42431)
0808 09:58:50.738709 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:50.738712 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:50.738887 (+ 175us) server_negotiation.cc:407] Connection header received
0808 09:58:50.739440 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:50.739442 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:50.739455 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:50.739526 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:50.740471 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.740991 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.742069 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.742273 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.742349 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.744685 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:50.744687 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:50.744687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:50.744696 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:50.746174 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:50.746600 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:50.746601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:50.746602 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:50.746667 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:50.746924 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:50.746925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:50.746925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:50.747046 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:50.747122 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:50.747503 (+ 381us) server_negotiation.cc:299] Negotiation successful
0808 09:58:50.747591 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 09:58:50.747941 8007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.738603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:42431 (local address 127.24.71.194:50513)
0808 09:58:50.738762 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:50.738805 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:50.739317 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:50.739581 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:50.739584 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:50.740163 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:50.740358 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:50.740363 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.741116 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.741117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:50.741967 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:50.741969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.742362 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.742363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:50.742488 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.742968 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:50.742976 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:50.744575 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:50.746276 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:50.746284 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:50.746286 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:50.746523 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:50.746733 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:50.746734 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:50.746735 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:50.746856 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:50.747111 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:50.747118 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:50.747304 (+ 186us) client_negotiation.cc:769] Sending connection context
0808 09:58:50.747473 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 09:58:50.747693 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260808 09:58:50.748512 8005 heartbeater.cc:347] Connected to a master server at 127.24.71.254:42431
I20260808 09:58:50.748679 8005 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:50.748870 8005 heartbeater.cc:511] Master 127.24.71.254:42431 requested a full tablet report, sending...
I20260808 09:58:50.749287 7507 ts_manager.cc:194] Registered new tserver with Master: 77748924e1cd4940adc2439f9ac92e1a (127.24.71.194:44397)
I20260808 09:58:50.749848 7507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:50513
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 09:58:50.772356 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:42431
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:41657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:58:50.855955 8010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:58:50.856177 8010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:58:50.856202 8010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:58:50.857353 8010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:58:50.857398 8010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:58:50.857424 8010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:58:50.858911 8010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:42431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:58:50.859176 8010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:58:50.859452 8010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:58:50.864523 8023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:50.864509 8021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:58:50.864531 8027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:58:50.864755 8010 server_base.cc:1034] running on GCE node
I20260808 09:58:50.865010 8010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:58:50.865218 8010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:58:50.866357 8010 hybrid_clock.cc:648] HybridClock initialized: now 1786183130866346 us; error 29 us; skew 500 ppm
Aug 08 09:58:50 dist-test-slave-gw5c krb5kdc[7439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183130, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:58:50.869086 8010 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 09:58:50.869666 8010 webserver.cc:460] Webserver started at http://127.24.71.195:44757/ using document root <none> and password file <none>
I20260808 09:58:50.869954 8010 fs_manager.cc:359] Metadata directory not provided
I20260808 09:58:50.870028 8010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:58:50.870167 8010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 09:58:50.871320 8010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "5c528fd6a16748b6ac4702c3a487df9c"
format_stamp: "Formatted at 2026-08-08 09:58:50 on dist-test-slave-gw5c"
server_key: "00e2066555b6f641f259795c6f43b40b"
server_key_iv: "5fbb3e4bd5dc7508da0464f5f8298ce2"
server_key_version: "encryptionkey@0"
I20260808 09:58:50.871764 8010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "5c528fd6a16748b6ac4702c3a487df9c"
format_stamp: "Formatted at 2026-08-08 09:58:50 on dist-test-slave-gw5c"
server_key: "00e2066555b6f641f259795c6f43b40b"
server_key_iv: "5fbb3e4bd5dc7508da0464f5f8298ce2"
server_key_version: "encryptionkey@0"
I20260808 09:58:50.873122 8010 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 09:58:50.873883 8044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:50.874070 8010 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 09:58:50.874161 8010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "5c528fd6a16748b6ac4702c3a487df9c"
format_stamp: "Formatted at 2026-08-08 09:58:50 on dist-test-slave-gw5c"
server_key: "00e2066555b6f641f259795c6f43b40b"
server_key_iv: "5fbb3e4bd5dc7508da0464f5f8298ce2"
server_key_version: "encryptionkey@0"
I20260808 09:58:50.874236 8010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:58:50.887135 8010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:58:50.889514 8010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:58:50.889669 8010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:58:50.889928 8010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:58:50.890249 8010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:58:50.890281 8010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:50.890332 8010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:58:50.890359 8010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:58:50.896286 8010 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:36075
I20260808 09:58:50.896330 8229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:36075 every 8 connection(s)
I20260808 09:58:50.896658 8010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 09:58:50.898414 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 8010
I20260808 09:58:50.898522 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:58:50.898757 24863 external_mini_cluster.cc:1428] Setting key 2ac82c4f7f9cdc6bd873537645699e21
Aug 08 09:58:50 dist-test-slave-gw5c krb5kdc[7439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183130, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:58:50.906380 7565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.897399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:41273 (local address 127.24.71.254:42431)
0808 09:58:50.897461 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:50.897463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:50.897714 (+ 251us) server_negotiation.cc:407] Connection header received
0808 09:58:50.898173 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:50.898174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:50.898185 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:50.898247 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:50.899619 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.900178 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.901192 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.901416 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.901490 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.903696 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:50.903698 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:50.903698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:50.903707 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:50.905008 (+ 1301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:50.905412 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:50.905413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:50.905413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:50.905476 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:50.905728 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:50.905729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:50.905729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:50.905851 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:50.905924 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:50.906195 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 09:58:50.906281 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 09:58:50.906623 8233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.897383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:42431 (local address 127.24.71.195:41273)
0808 09:58:50.897557 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:50.897620 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:50.898094 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:50.898323 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:50.898328 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:50.899203 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:58:50.899530 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:50.899535 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.900274 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.900275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:50.901103 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:50.901105 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.901496 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.901498 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:50.901630 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.902160 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:58:50.902168 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:58:50.903602 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:58:50.905091 (+ 1489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:50.905098 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:50.905101 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:50.905329 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:50.905542 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:58:50.905542 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:58:50.905543 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:58:50.905657 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:58:50.905918 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:58:50.905925 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:58:50.906066 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 09:58:50.906176 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 09:58:50.906342 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
I20260808 09:58:50.907135 8230 heartbeater.cc:347] Connected to a master server at 127.24.71.254:42431
I20260808 09:58:50.907243 8230 heartbeater.cc:464] Registering TS with master...
I20260808 09:58:50.907476 8230 heartbeater.cc:511] Master 127.24.71.254:42431 requested a full tablet report, sending...
I20260808 09:58:50.907877 7507 ts_manager.cc:194] Registered new tserver with Master: 5c528fd6a16748b6ac4702c3a487df9c (127.24.71.195:36075)
I20260808 09:58:50.908265 7507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:41273
I20260808 09:58:50.910458 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 09:58:50.917930 7565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.911813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41776 (local address 127.24.71.254:42431)
0808 09:58:50.911870 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:50.911872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:50.911993 (+ 121us) server_negotiation.cc:407] Connection header received
0808 09:58:50.912066 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:50.912067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:50.912091 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:50.912157 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:58:50.912716 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.913290 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.914107 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.914330 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.914392 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.915568 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:58:50.915570 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:58:50.915570 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:58:50.915578 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:58:50.916690 (+ 1112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:50.917048 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:50.917049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:50.917049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:50.917109 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:58:50.917308 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:58:50.917309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:58:50.917310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:58:50.917476 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:58:50.917581 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:50.917731 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 09:58:50.917822 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 09:58:50.919518 7507 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41776:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:58:50.921119 7507 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:58:50.927815 8248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.923468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:36075 (local address 127.0.0.1:32768)
0808 09:58:50.923635 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:50.923679 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:50.923757 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:50.924256 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:50.924259 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:50.924262 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:50.924360 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:50.924363 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.925405 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.925406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:50.926708 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:50.926711 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.927490 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.927491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:50.927572 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.927587 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 09:58:50.927657 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 09:58:50.927718 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":50,"threads_started":1}
I20260808 09:58:50.927913 8246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.923474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:44397 (local address 127.0.0.1:52504)
0808 09:58:50.923926 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:50.923935 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:50.924014 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:50.924286 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:50.924287 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:50.924289 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:50.924360 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:50.924361 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.925746 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.925747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:50.926678 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:50.926681 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.927640 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.927641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:50.927709 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.927712 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:50.927766 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 09:58:50.927797 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"mutex_wait_us":19,"thread_start_us":85,"threads_started":1}
I20260808 09:58:50.927946 8252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.923663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52504 (local address 127.24.71.194:44397)
0808 09:58:50.923870 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:50.923875 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:50.924005 (+ 130us) server_negotiation.cc:407] Connection header received
0808 09:58:50.924091 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:50.924094 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:50.924114 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:50.924196 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:50.924465 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.925619 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.926768 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.927552 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.927639 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.927697 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:50.927793 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 09:58:50.927843 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":94,"threads_started":1}
I20260808 09:58:50.928185 8253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.923852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32768 (local address 127.24.71.195:36075)
0808 09:58:50.924031 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:50.924035 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:50.924045 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:50.924116 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:50.924119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:50.924135 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:50.924565 (+ 430us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:50.924647 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.925292 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.926808 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.927374 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.927491 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.927562 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:50.928068 (+ 506us) server_negotiation.cc:299] Negotiation successful
0808 09:58:50.928116 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":118,"threads_started":1}
I20260808 09:58:50.928738 8249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.923541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:38805 (local address 127.0.0.1:59738)
0808 09:58:50.924101 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:50.924110 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:50.924152 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:50.924373 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:50.924374 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:50.924376 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:50.924415 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:50.924416 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.925728 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.925729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:50.926848 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:50.926851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.927886 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.927887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:50.928537 (+ 650us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.928543 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 09:58:50.928605 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 09:58:50.928652 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"mutex_wait_us":34,"thread_start_us":81,"threads_started":1}
I20260808 09:58:50.928722 7899 tablet_service.cc:1467] Processing CreateTablet for tablet c874da8e38de4d3a97a01c6386bb241c (DEFAULT_TABLE table=test-table [id=562040ea8b2b4f49b55e8da5eaec28f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:50.928833 8124 tablet_service.cc:1467] Processing CreateTablet for tablet c874da8e38de4d3a97a01c6386bb241c (DEFAULT_TABLE table=test-table [id=562040ea8b2b4f49b55e8da5eaec28f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:50.929109 8250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:50.923590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59738 (local address 127.24.71.193:38805)
0808 09:58:50.923769 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:50.923775 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:50.924214 (+ 439us) server_negotiation.cc:407] Connection header received
0808 09:58:50.924257 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:50.924259 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:50.924275 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:50.924360 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:50.924491 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.925615 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.926931 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:50.927707 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:50.927793 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:50.927849 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:50.928994 (+ 1145us) server_negotiation.cc:299] Negotiation successful
0808 09:58:50.929041 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":91,"threads_started":1}
I20260808 09:58:50.929143 8124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c874da8e38de4d3a97a01c6386bb241c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:50.929143 7899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c874da8e38de4d3a97a01c6386bb241c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:50.929801 7697 tablet_service.cc:1467] Processing CreateTablet for tablet c874da8e38de4d3a97a01c6386bb241c (DEFAULT_TABLE table=test-table [id=562040ea8b2b4f49b55e8da5eaec28f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:58:50.930126 7697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c874da8e38de4d3a97a01c6386bb241c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:58:50.932587 8255 tablet_bootstrap.cc:492] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c: Bootstrap starting.
I20260808 09:58:50.932818 8256 tablet_bootstrap.cc:492] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a: Bootstrap starting.
I20260808 09:58:50.932924 8257 tablet_bootstrap.cc:492] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22: Bootstrap starting.
I20260808 09:58:50.933494 8256 tablet_bootstrap.cc:654] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:50.933507 8257 tablet_bootstrap.cc:654] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:50.934000 8257 log.cc:824] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:50.934005 8256 log.cc:824] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:50.934749 8257 tablet_bootstrap.cc:492] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22: No bootstrap required, opened a new log
I20260808 09:58:50.934804 8256 tablet_bootstrap.cc:492] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a: No bootstrap required, opened a new log
I20260808 09:58:50.934835 8257 ts_tablet_manager.cc:1397] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 09:58:50.934942 8256 ts_tablet_manager.cc:1397] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 09:58:50.935112 8255 tablet_bootstrap.cc:654] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c: Neither blocks nor log segments found. Creating new log.
I20260808 09:58:50.935781 8255 log.cc:824] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c: Log is configured to *not* fsync() on all Append() calls
I20260808 09:58:50.936599 8255 tablet_bootstrap.cc:492] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c: No bootstrap required, opened a new log
I20260808 09:58:50.936673 8255 ts_tablet_manager.cc:1397] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 09:58:50.936687 8257 raft_consensus.cc:348] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77748924e1cd4940adc2439f9ac92e1a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44397 } } peers { permanent_uuid: "5c528fd6a16748b6ac4702c3a487df9c" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36075 } } peers { permanent_uuid: "52c9d20c083e4081b430615fbff0bf22" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38805 } }
I20260808 09:58:50.936878 8257 raft_consensus.cc:374] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:50.936923 8257 raft_consensus.cc:729] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52c9d20c083e4081b430615fbff0bf22, State: Initialized, Role: FOLLOWER
I20260808 09:58:50.937074 8257 consensus_queue.cc:260] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77748924e1cd4940adc2439f9ac92e1a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44397 } } peers { permanent_uuid: "5c528fd6a16748b6ac4702c3a487df9c" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36075 } } peers { permanent_uuid: "52c9d20c083e4081b430615fbff0bf22" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38805 } }
I20260808 09:58:50.937079 8256 raft_consensus.cc:348] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77748924e1cd4940adc2439f9ac92e1a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44397 } } peers { permanent_uuid: "5c528fd6a16748b6ac4702c3a487df9c" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36075 } } peers { permanent_uuid: "52c9d20c083e4081b430615fbff0bf22" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38805 } }
I20260808 09:58:50.937240 8256 raft_consensus.cc:374] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:50.937276 8256 raft_consensus.cc:729] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77748924e1cd4940adc2439f9ac92e1a, State: Initialized, Role: FOLLOWER
I20260808 09:58:50.937361 8257 ts_tablet_manager.cc:1428] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 09:58:50.937394 8256 consensus_queue.cc:260] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77748924e1cd4940adc2439f9ac92e1a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44397 } } peers { permanent_uuid: "5c528fd6a16748b6ac4702c3a487df9c" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36075 } } peers { permanent_uuid: "52c9d20c083e4081b430615fbff0bf22" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38805 } }
I20260808 09:58:50.937489 7793 heartbeater.cc:503] Master 127.24.71.254:42431 was elected leader, sending a full tablet report...
I20260808 09:58:50.937665 8256 ts_tablet_manager.cc:1428] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 09:58:50.937703 8005 heartbeater.cc:503] Master 127.24.71.254:42431 was elected leader, sending a full tablet report...
I20260808 09:58:50.938656 8255 raft_consensus.cc:348] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77748924e1cd4940adc2439f9ac92e1a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44397 } } peers { permanent_uuid: "5c528fd6a16748b6ac4702c3a487df9c" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36075 } } peers { permanent_uuid: "52c9d20c083e4081b430615fbff0bf22" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38805 } }
I20260808 09:58:50.938827 8255 raft_consensus.cc:374] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:58:50.938874 8255 raft_consensus.cc:729] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c528fd6a16748b6ac4702c3a487df9c, State: Initialized, Role: FOLLOWER
I20260808 09:58:50.939002 8255 consensus_queue.cc:260] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77748924e1cd4940adc2439f9ac92e1a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44397 } } peers { permanent_uuid: "5c528fd6a16748b6ac4702c3a487df9c" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36075 } } peers { permanent_uuid: "52c9d20c083e4081b430615fbff0bf22" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38805 } }
I20260808 09:58:50.939262 8255 ts_tablet_manager.cc:1428] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 09:58:50.939380 8230 heartbeater.cc:503] Master 127.24.71.254:42431 was elected leader, sending a full tablet report...
W20260808 09:58:50.988515 8006 tablet.cc:2369] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 09:58:51.072466 7794 tablet.cc:2369] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 09:58:51.147318 8232 tablet.cc:2369] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 09:58:51.179004 8268 raft_consensus.cc:482] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:58:51.179140 8268 raft_consensus.cc:504] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77748924e1cd4940adc2439f9ac92e1a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44397 } } peers { permanent_uuid: "5c528fd6a16748b6ac4702c3a487df9c" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36075 } } peers { permanent_uuid: "52c9d20c083e4081b430615fbff0bf22" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38805 } }
I20260808 09:58:51.179505 8268 leader_election.cc:288] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77748924e1cd4940adc2439f9ac92e1a (127.24.71.194:44397), 52c9d20c083e4081b430615fbff0bf22 (127.24.71.193:38805)
I20260808 09:58:51.182679 8233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:51.179726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:44397 (local address 127.24.71.195:59355)
0808 09:58:51.179781 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:51.179796 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:51.179849 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:51.180015 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:51.180016 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:51.180018 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:51.180103 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:51.180105 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:51.180894 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:51.180895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:51.181731 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:51.181734 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:51.182399 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:51.182400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:51.182492 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:51.182495 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 09:58:51.182560 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 09:58:51.182602 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 09:58:51.182679 8252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:51.179814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:59355 (local address 127.24.71.194:44397)
0808 09:58:51.179871 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:51.179873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:51.179883 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:58:51.179911 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:51.179912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:51.179922 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:51.179990 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:51.180181 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:51.180802 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:51.181827 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:51.182317 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:51.182409 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:51.182419 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:51.182568 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 09:58:51.182607 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 09:58:51.182967 8269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:51.179734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:38805 (local address 127.24.71.195:51903)
0808 09:58:51.180113 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:51.180122 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 09:58:51.180198 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:58:51.180336 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:58:51.180337 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:58:51.180339 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:58:51.180406 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:51.180407 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:51.181052 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:51.181053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:51.182008 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:58:51.182011 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:58:51.182659 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:58:51.182661 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:58:51.182743 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:51.182748 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 09:58:51.182812 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 09:58:51.182867 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"mutex_wait_us":173,"thread_start_us":129,"threads_started":1}
I20260808 09:58:51.183161 8250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:51.179803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:51903 (local address 127.24.71.193:38805)
0808 09:58:51.179865 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:51.179867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:51.180188 (+ 321us) server_negotiation.cc:407] Connection header received
0808 09:58:51.180261 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:51.180262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:51.180274 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:51.180320 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:58:51.180471 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:51.180959 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:51.182118 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:51.182574 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:51.182659 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:51.182668 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:51.183027 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 09:58:51.183082 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 09:58:51.183175 7935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c874da8e38de4d3a97a01c6386bb241c" candidate_uuid: "5c528fd6a16748b6ac4702c3a487df9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77748924e1cd4940adc2439f9ac92e1a" is_pre_election: true
I20260808 09:58:51.183326 7935 raft_consensus.cc:2454] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c528fd6a16748b6ac4702c3a487df9c in term 0.
I20260808 09:58:51.183494 7729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c874da8e38de4d3a97a01c6386bb241c" candidate_uuid: "5c528fd6a16748b6ac4702c3a487df9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52c9d20c083e4081b430615fbff0bf22" is_pre_election: true
I20260808 09:58:51.183581 8049 leader_election.cc:302] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c528fd6a16748b6ac4702c3a487df9c, 77748924e1cd4940adc2439f9ac92e1a; no voters:
I20260808 09:58:51.183665 7729 raft_consensus.cc:2454] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c528fd6a16748b6ac4702c3a487df9c in term 0.
I20260808 09:58:51.183743 8268 raft_consensus.cc:2781] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:58:51.183816 8268 raft_consensus.cc:482] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:58:51.183851 8268 raft_consensus.cc:3037] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:51.184593 8268 raft_consensus.cc:504] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77748924e1cd4940adc2439f9ac92e1a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44397 } } peers { permanent_uuid: "5c528fd6a16748b6ac4702c3a487df9c" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36075 } } peers { permanent_uuid: "52c9d20c083e4081b430615fbff0bf22" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38805 } }
I20260808 09:58:51.184754 8268 leader_election.cc:288] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [CANDIDATE]: Term 1 election: Requested vote from peers 77748924e1cd4940adc2439f9ac92e1a (127.24.71.194:44397), 52c9d20c083e4081b430615fbff0bf22 (127.24.71.193:38805)
I20260808 09:58:51.184932 7729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c874da8e38de4d3a97a01c6386bb241c" candidate_uuid: "5c528fd6a16748b6ac4702c3a487df9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52c9d20c083e4081b430615fbff0bf22"
I20260808 09:58:51.184957 7935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c874da8e38de4d3a97a01c6386bb241c" candidate_uuid: "5c528fd6a16748b6ac4702c3a487df9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77748924e1cd4940adc2439f9ac92e1a"
I20260808 09:58:51.185024 7729 raft_consensus.cc:3037] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:51.185055 7935 raft_consensus.cc:3037] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:58:51.185757 7729 raft_consensus.cc:2454] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c528fd6a16748b6ac4702c3a487df9c in term 1.
I20260808 09:58:51.185923 7935 raft_consensus.cc:2454] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c528fd6a16748b6ac4702c3a487df9c in term 1.
I20260808 09:58:51.185994 8046 leader_election.cc:302] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52c9d20c083e4081b430615fbff0bf22, 5c528fd6a16748b6ac4702c3a487df9c; no voters:
I20260808 09:58:51.186076 8268 raft_consensus.cc:2781] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:58:51.186249 8268 raft_consensus.cc:686] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [term 1 LEADER]: Becoming Leader. State: Replica: 5c528fd6a16748b6ac4702c3a487df9c, State: Running, Role: LEADER
I20260808 09:58:51.186352 8268 consensus_queue.cc:237] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77748924e1cd4940adc2439f9ac92e1a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44397 } } peers { permanent_uuid: "5c528fd6a16748b6ac4702c3a487df9c" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36075 } } peers { permanent_uuid: "52c9d20c083e4081b430615fbff0bf22" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38805 } }
I20260808 09:58:51.187216 7507 catalog_manager.cc:5495] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c528fd6a16748b6ac4702c3a487df9c (127.24.71.195). New cstate: current_term: 1 leader_uuid: "5c528fd6a16748b6ac4702c3a487df9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77748924e1cd4940adc2439f9ac92e1a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c528fd6a16748b6ac4702c3a487df9c" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 36075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "52c9d20c083e4081b430615fbff0bf22" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38805 } health_report { overall_health: UNKNOWN } } }
I20260808 09:58:51.209928 8253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:51.207798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32782 (local address 127.24.71.195:36075)
0808 09:58:51.207851 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 09:58:51.207853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:58:51.207876 (+ 23us) server_negotiation.cc:407] Connection header received
0808 09:58:51.207914 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:58:51.207915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:58:51.207932 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:58:51.207987 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:58:51.208092 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:51.208563 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:51.209270 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:58:51.209457 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:58:51.209507 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:58:51.209636 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:58:51.209732 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:58:51.209792 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 09:58:51.209828 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 09:58:51.209847 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 09:58:51.211879 7729 raft_consensus.cc:1261] T c874da8e38de4d3a97a01c6386bb241c P 52c9d20c083e4081b430615fbff0bf22 [term 1 FOLLOWER]: Refusing update from remote peer 5c528fd6a16748b6ac4702c3a487df9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:51.211925 7935 raft_consensus.cc:1261] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a [term 1 FOLLOWER]: Refusing update from remote peer 5c528fd6a16748b6ac4702c3a487df9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:58:51.212265 8268 consensus_queue.cc:1035] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "77748924e1cd4940adc2439f9ac92e1a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:51.212441 8270 consensus_queue.cc:1035] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "52c9d20c083e4081b430615fbff0bf22" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 38805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:58:51.215082 8275 mvcc.cc:205] Tried to move back new op lower bound from 7316206105440813056 to 7316206105339973632. Current Snapshot: MvccSnapshot[applied={T|T < 7316206105440813056}]
I20260808 09:58:51.217672 7505 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:51.217767 7505 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:58:51.218600 7505 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b0e2935583654d2db0374dfc39bf4446: Sending DeleteTablet for 3 replicas of tablet c874da8e38de4d3a97a01c6386bb241c
I20260808 09:58:51.218935 8124 tablet_service.cc:1514] Processing DeleteTablet for tablet c874da8e38de4d3a97a01c6386bb241c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:51 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:32768
I20260808 09:58:51.218990 7899 tablet_service.cc:1514] Processing DeleteTablet for tablet c874da8e38de4d3a97a01c6386bb241c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:51 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:52504
I20260808 09:58:51.219236 8292 tablet_replica.cc:330] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a: stopping tablet replica
I20260808 09:58:51.219236 8291 tablet_replica.cc:330] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c: stopping tablet replica
I20260808 09:58:51.219350 8292 raft_consensus.cc:2229] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:58:51.219357 7697 tablet_service.cc:1514] Processing DeleteTablet for tablet c874da8e38de4d3a97a01c6386bb241c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:58:51 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:59738
I20260808 09:58:51.219492 8292 raft_consensus.cc:2258] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:51.219377 8291 raft_consensus.cc:2229] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [term 1 LEADER]: Raft consensus shutting down.
I20260808 09:58:51.219691 8291 raft_consensus.cc:2258] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:58:51.219951 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 7595
I20260808 09:58:51.227087 8292 ts_tablet_manager.cc:1905] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:51.227478 8291 ts_tablet_manager.cc:1905] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:58:51.228977 8292 ts_tablet_manager.cc:1918] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:51.229070 8292 log.cc:1196] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/c874da8e38de4d3a97a01c6386bb241c
I20260808 09:58:51.229339 8292 ts_tablet_manager.cc:1939] T c874da8e38de4d3a97a01c6386bb241c P 77748924e1cd4940adc2439f9ac92e1a: Deleting consensus metadata
I20260808 09:58:51.229810 7489 catalog_manager.cc:4841] TS 77748924e1cd4940adc2439f9ac92e1a (127.24.71.194:44397): tablet c874da8e38de4d3a97a01c6386bb241c (table test-table [id=562040ea8b2b4f49b55e8da5eaec28f7]) successfully deleted
I20260808 09:58:51.230751 8291 ts_tablet_manager.cc:1918] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:58:51.230854 8291 log.cc:1196] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/c874da8e38de4d3a97a01c6386bb241c
I20260808 09:58:51.231124 8291 ts_tablet_manager.cc:1939] T c874da8e38de4d3a97a01c6386bb241c P 5c528fd6a16748b6ac4702c3a487df9c: Deleting consensus metadata
I20260808 09:58:51.231570 7488 catalog_manager.cc:4841] TS 5c528fd6a16748b6ac4702c3a487df9c (127.24.71.195:36075): tablet c874da8e38de4d3a97a01c6386bb241c (table test-table [id=562040ea8b2b4f49b55e8da5eaec28f7]) successfully deleted
W20260808 09:58:51.239107 7487 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:38805 (error 108)
I20260808 09:58:51.239333 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 7800
I20260808 09:58:51.247117 8249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:58:51.246960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:38805 (local address 127.0.0.1:59746)
0808 09:58:51.247024 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 09:58:51.247069 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:38805: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 09:58:51.249603 7487 catalog_manager.cc:4584] TS 52c9d20c083e4081b430615fbff0bf22 (127.24.71.193:38805): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c874da8e38de4d3a97a01c6386bb241c: Network error: Client connection negotiation failed: client connection to 127.24.71.193:38805: connect: Connection refused (error 111)
I20260808 09:58:51.254606 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 8010
I20260808 09:58:51.266651 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 7456
2026-08-08T09:58:51Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2390 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:58:51 dist-test-slave-gw5c krb5kdc[8303](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:58:51 dist-test-slave-gw5c krb5kdc[8303](info): set up 2 sockets
Aug 08 09:58:51 dist-test-slave-gw5c krb5kdc[8303](info): commencing operation
krb5kdc: starting...
W20260808 09:58:52.521380 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:58:52 dist-test-slave-gw5c krb5kdc[8303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:58:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:58:52Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.24.71.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.24.71.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/rangeradmin_127.24.71.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/rangeradmin_127.24.71.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.24.71.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.24.71.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/rangerlookup_127.24.71.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/rangerlookup_127.24.71.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.71.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.24.71.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/HTTP_127.24.71.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/HTTP_127.24.71.212@KRBTEST.COM.keytab.
I20260808 09:58:52.697948 24863 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskzT1q8T/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/postgres -l logfile start
2026-08-08 09:58:55.201 UTC [8341] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 09:58:55.201 UTC [8341] LOG: listening on IPv4 address "127.24.71.212", port 49811
2026-08-08 09:58:55.205 UTC [8341] LOG: listening on Unix socket "/tmp/.s.PGSQL.49811"
2026-08-08 09:58:55.241 UTC [8348] LOG: database system was shut down at 2026-08-08 09:58:53 UTC
2026-08-08 09:58:55.245 UTC [8341] LOG: database system is ready to accept connections
I20260808 09:58:56.384488 24863 mini_postgres.cc:96] Postgres bound to 49811
2026-08-08 09:58:56.392 UTC [8358] FATAL: database "slave" does not exist
127.24.71.212:49811 - accepting connections
I20260808 09:58:56.393558 24863 mini_ranger.cc:161] Starting Ranger...
I20260808 09:58:56.410121 24863 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 09:58:56.926505 24863 mini_ranger.cc:87] Created ranger Postgres database
I20260808 09:58:56.926582 24863 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-admin
2026-08-08 09:58:57,238 [I] DB FLAVOR :POSTGRES
2026-08-08 09:58:57,239 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 09:58:57,239 [I] Checking connection..
2026-08-08 09:58:57,239 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 09:58:57,498 [I] Checking connection passed.
2026-08-08 09:58:57,499 [I] --------- Verifying version history table ---------
2026-08-08 09:58:57,499 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 09:58:57,768 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 09:58:57,769 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 09:58:58,028 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 09:58:58,028 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 09:58:58,028 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 09:58:58.293 UTC [8464] WARNING: there is no transaction in progress
2026-08-08 09:58:58,302 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 09:58:58,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 09:58:58,577 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 09:58:58,577 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 09:58:58,577 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 09:58:58,826 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 09:58:59,079 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gw5c.c.gcp-upstream.internal','N') ;"
2026-08-08 09:58:59,346 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 09:58:59,622 [I] Table x_portal_user does not exist in database ranger
2026-08-08 09:58:59,623 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 09:58:59,883 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 09:58:59,883 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 09:59:00,151 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 09:59:00,414 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 09:59:00,414 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 09:59:01.395 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.411 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.428 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.444 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.459 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.476 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.531 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.538 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.554 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.564 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.574 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.589 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.599 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.606 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.613 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:01.620 UTC [8636] WARNING: there is no transaction in progress
2026-08-08 09:59:02,281 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 09:59:02,282 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 09:59:02,512 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 09:59:02,513 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 09:59:02,786 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 09:59:02,786 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 09:59:03,069 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 09:59:03,070 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 09:59:03,351 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 09:59:03,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gw5c.c.gcp-upstream.internal';"
2026-08-08 09:59:03,862 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 09:59:03,862 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 09:59:04,133 [I] DB_PATCHES have already been applied
I20260808 09:59:04.139508 24863 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-admin:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskzT1q8T/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 09:59:04.139581 24863 mini_ranger.cc:193] Using host: 127.24.71.212
I20260808 09:59:04.143527 24863 mini_ranger.cc:227] Ranger admin URL: http://127.24.71.212:59323
Aug 08, 2026 9:59:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 9:59:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 9:59:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 9:59:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 9:59:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 9:59:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 9:59:05 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 09:59:05.547871 24863 mini_ranger.cc:160] Time spent starting Ranger: real 9.154s user 0.001s sys 0.011s
Aug 08, 2026 9:59:25 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 9:59:25 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 9:59:25 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 9:59:25 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 9:59:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 9:59:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 9:59:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 9:59:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 9:59:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 9:59:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 9:59:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 9:59:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 9:59:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 9:59:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 9:59:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 9:59:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 9:59:25 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 9:59:26 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 09:59:27.243167 24863 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.24.71.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.24.71.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/rangerkms_127.24.71.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/rangerkms_127.24.71.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.71.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.24.71.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.71.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/HTTP_127.24.71.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.71.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/HTTP_127.24.71.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 09:59:27 dist-test-slave-gw5c krb5kdc[8303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183167, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 09:59:27.338500 24863 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 09:59:27.351598 24863 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 09:59:28.239588 24863 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 09:59:28.239677 24863 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-kms
I20260808 09:59:28.239701 24863 mini_ranger_kms.cc:227] Using postgres at 127.24.71.212:49811
2026-08-08 09:59:28,923 [I] DB FLAVOR :POSTGRES
2026-08-08 09:59:28,924 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 09:59:28,924 [I] Checking connection
2026-08-08 09:59:28,924 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 09:59:29,242 [I] connection success
2026-08-08 09:59:29,243 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 09:59:29,243 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 09:59:29,243 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 09:59:29,507 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 09:59:29,507 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 09:59:29,507 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 09:59:29,507 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:49811/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 09:59:29,815 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 09:59:30.297411 24863 mini_ranger_kms.cc:310] Created kms service
I20260808 09:59:30.495656 24863 mini_ranger_kms.cc:326] Created kudu user
I20260808 09:59:30.541867 24863 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 09:59:30 dist-test-slave-gw5c krb5kdc[8303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183167, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 09:59:30.945978 24863 mini_ranger_kms.cc:384] Added ranger policy
I20260808 09:59:30.946110 24863 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-kms:/tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 09:59:30.946131 24863 mini_ranger_kms.cc:240] Using host: 127.24.71.212
I20260808 09:59:30.950806 24863 mini_ranger_kms.cc:276] Ranger KMS PID: 8921
I20260808 09:59:30.950963 24863 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.24.71.212:54915
Aug 08, 2026 9:59:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 9:59:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 9:59:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 9:59:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 9:59:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 9:59:32 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 09:59:33 dist-test-slave-gw5c krb5kdc[8303](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786183173, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.71.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:59:33.897042 24863 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.559s user 0.004s sys 0.657s
I20260808 09:59:33.897190 24863 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 09:59:33.897291 24863 mini_ranger_kms.cc:401] 127.24.71.212:54915/kms/v1/keys
Aug 08 09:59:34 dist-test-slave-gw5c krb5kdc[8303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183173, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.71.212@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
Aug 08 09:59:34 dist-test-slave-gw5c krb5kdc[8303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183173, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.71.212@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
Aug 08 09:59:37 dist-test-slave-gw5c krb5kdc[8303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 09:59:37.282398 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:35611
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:35611
--ranger_config_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.71.212:54915/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:59:37.412140 9001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:59:37.412429 9001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:59:37.412475 9001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:59:37.413772 9001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 09:59:37.413851 9001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:59:37.413882 9001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:59:37.413920 9001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 09:59:37.413954 9001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 09:59:37.415937 9001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/wal
--ranger_kms_url=127.24.71.212:54915/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:35611
--ranger_config_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:35611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:59:37.416288 9001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:59:37.416671 9001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 09:59:37.422843 9001 server_base.cc:1034] running on GCE node
W20260808 09:59:37.422860 9012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:59:37.422921 9014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:59:37.422941 9016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:59:37.423480 9001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:59:37.423884 9001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:59:37.425081 9001 hybrid_clock.cc:648] HybridClock initialized: now 1786183177425058 us; error 39 us; skew 500 ppm
Aug 08 09:59:37 dist-test-slave-gw5c krb5kdc[8303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183177, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:59:37.429224 9001 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 09:59:37.429740 9001 webserver.cc:460] Webserver started at http://127.24.71.254:44559/ using document root <none> and password file <none>
I20260808 09:59:37.430022 9001 fs_manager.cc:359] Metadata directory not provided
I20260808 09:59:37.430088 9001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:59:37.430249 9001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 09:59:37 dist-test-slave-gw5c krb5kdc[8303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183177, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 09:59:37.486738 9001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "5f39025c6e85447595ecdf042c4d3369"
format_stamp: "Formatted at 2026-08-08 09:59:37 on dist-test-slave-gw5c"
server_key: "48d4d4b30417d145d6456ac97c782695"
server_key_iv: "b7f0fc141e141effa4a9565851356964"
server_key_version: "kuduclusterkey@0"
I20260808 09:59:37.487493 9001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "5f39025c6e85447595ecdf042c4d3369"
format_stamp: "Formatted at 2026-08-08 09:59:37 on dist-test-slave-gw5c"
server_key: "48d4d4b30417d145d6456ac97c782695"
server_key_iv: "b7f0fc141e141effa4a9565851356964"
server_key_version: "kuduclusterkey@0"
I20260808 09:59:37.489195 9001 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 09:59:37.502187 9027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:59:37.502437 9001 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 09:59:37.502557 9001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "5f39025c6e85447595ecdf042c4d3369"
format_stamp: "Formatted at 2026-08-08 09:59:37 on dist-test-slave-gw5c"
server_key: "48d4d4b30417d145d6456ac97c782695"
server_key_iv: "b7f0fc141e141effa4a9565851356964"
server_key_version: "kuduclusterkey@0"
I20260808 09:59:37.502681 9001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:59:37.511101 9001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:59:37.513437 9001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:59:37.513649 9001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:59:37.523808 9001 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:35611
I20260808 09:59:37.523833 9114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:35611 every 8 connection(s)
I20260808 09:59:37.524312 9001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 09:59:37.525367 9116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:59:37.528177 9116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369: Bootstrap starting.
I20260808 09:59:37.529145 9116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369: Neither blocks nor log segments found. Creating new log.
I20260808 09:59:37.529727 9116 log.cc:824] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369: Log is configured to *not* fsync() on all Append() calls
I20260808 09:59:37.530624 9116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369: No bootstrap required, opened a new log
I20260808 09:59:37.530937 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 9001
I20260808 09:59:37.531064 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 09:59:37.531304 24863 external_mini_cluster.cc:1428] Setting key 62fefe992e3dfb6ffc6f40e356520cbf
I20260808 09:59:37.535241 9116 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f39025c6e85447595ecdf042c4d3369" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35611 } }
I20260808 09:59:37.535467 9116 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:59:37.535506 9116 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f39025c6e85447595ecdf042c4d3369, State: Initialized, Role: FOLLOWER
I20260808 09:59:37.535696 9116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f39025c6e85447595ecdf042c4d3369" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35611 } }
I20260808 09:59:37.535773 9116 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 09:59:37.535804 9116 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 09:59:37.535863 9116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:59:37.536682 9116 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f39025c6e85447595ecdf042c4d3369" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35611 } }
I20260808 09:59:37.536818 9116 leader_election.cc:302] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f39025c6e85447595ecdf042c4d3369; no voters:
I20260808 09:59:37.537050 9116 leader_election.cc:288] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 09:59:37.537151 9125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:59:37.537360 9125 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [term 1 LEADER]: Becoming Leader. State: Replica: 5f39025c6e85447595ecdf042c4d3369, State: Running, Role: LEADER
I20260808 09:59:37.537468 9116 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 09:59:37.537492 9125 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f39025c6e85447595ecdf042c4d3369" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35611 } }
I20260808 09:59:37.538184 9125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f39025c6e85447595ecdf042c4d3369. Latest consensus state: current_term: 1 leader_uuid: "5f39025c6e85447595ecdf042c4d3369" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f39025c6e85447595ecdf042c4d3369" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35611 } } }
I20260808 09:59:37.538250 9129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f39025c6e85447595ecdf042c4d3369" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f39025c6e85447595ecdf042c4d3369" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35611 } } }
I20260808 09:59:37.538522 9129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [sys.catalog]: This master's current role is: LEADER
I20260808 09:59:37.538270 9125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369 [sys.catalog]: This master's current role is: LEADER
I20260808 09:59:37.540779 9116 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 08 09:59:37 dist-test-slave-gw5c krb5kdc[8303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:59:37.545876 9142 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 09:59:37.551927 9142 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 09:59:37.552310 9124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:37.532073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59354 (local address 127.24.71.254:35611)
0808 09:59:37.532413 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0808 09:59:37.532422 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 09:59:37.532488 (+ 66us) server_negotiation.cc:407] Connection header received
0808 09:59:37.533223 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:59:37.533232 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:59:37.533300 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:59:37.533458 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:59:37.534329 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:37.535995 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:37.537179 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:37.538375 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:37.538484 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:37.544039 (+ 5555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:59:37.544125 (+ 86us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:59:37.544125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:59:37.544415 (+ 290us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:59:37.549643 (+ 5228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:59:37.550177 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:59:37.550180 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:59:37.550180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:59:37.550318 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:59:37.550601 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:59:37.550602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:59:37.550602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:59:37.551111 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:59:37.551724 (+ 613us) server_negotiation.cc:1035] Waiting for connection context
0808 09:59:37.551800 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 09:59:37.551959 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":124,"threads_started":1}
I20260808 09:59:37.558445 9142 catalog_manager.cc:1347] Generated new cluster ID: 99762098ebe44c21b1c872949ef81000
I20260808 09:59:37.558518 9142 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 09:59:37.570107 9142 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 09:59:37.570914 9142 catalog_manager.cc:1504] Loading token signing keys...
I20260808 09:59:37.584100 9142 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369: Generated new TSK 0
I20260808 09:59:37.584425 9142 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 09:59:38.710489 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.71.212:54915/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35611
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:59:38.847352 9192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:59:38.847637 9192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:59:38.847666 9192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:59:38.848990 9192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:59:38.849032 9192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:59:38.849059 9192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 09:59:38.850812 9192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.24.71.212:54915/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35611
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:59:38.851064 9192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:59:38.851344 9192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:59:38.860026 9200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:59:38.860345 9199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:59:38.862061 9203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:59:38.862255 9192 server_base.cc:1034] running on GCE node
I20260808 09:59:38.862573 9192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:59:38.862948 9192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:59:38.864209 9192 hybrid_clock.cc:648] HybridClock initialized: now 1786183178864179 us; error 58 us; skew 500 ppm
Aug 08 09:59:38 dist-test-slave-gw5c krb5kdc[8303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183178, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:59:38.869038 9192 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 09:59:38.869619 9192 webserver.cc:460] Webserver started at http://127.24.71.193:43943/ using document root <none> and password file <none>
I20260808 09:59:38.869895 9192 fs_manager.cc:359] Metadata directory not provided
I20260808 09:59:38.869974 9192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:59:38.870174 9192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 09:59:38 dist-test-slave-gw5c krb5kdc[8303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183178, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 09:59:38.885085 9192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "969904832fbb4448872ce355ae7c2005"
format_stamp: "Formatted at 2026-08-08 09:59:38 on dist-test-slave-gw5c"
server_key: "3e2cb664878d69fcb60bcba0ae35841a"
server_key_iv: "f474db93ab3a784ed49bec80cd6b5372"
server_key_version: "kuduclusterkey@0"
I20260808 09:59:38.885794 9192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "969904832fbb4448872ce355ae7c2005"
format_stamp: "Formatted at 2026-08-08 09:59:38 on dist-test-slave-gw5c"
server_key: "3e2cb664878d69fcb60bcba0ae35841a"
server_key_iv: "f474db93ab3a784ed49bec80cd6b5372"
server_key_version: "kuduclusterkey@0"
I20260808 09:59:38.887797 9192 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260808 09:59:38.905668 9213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:59:38.905972 9192 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260808 09:59:38.906101 9192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "969904832fbb4448872ce355ae7c2005"
format_stamp: "Formatted at 2026-08-08 09:59:38 on dist-test-slave-gw5c"
server_key: "3e2cb664878d69fcb60bcba0ae35841a"
server_key_iv: "f474db93ab3a784ed49bec80cd6b5372"
server_key_version: "kuduclusterkey@0"
I20260808 09:59:38.906215 9192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:59:38.921676 9192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:59:38.924685 9192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:59:38.924945 9192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:59:38.925438 9192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:59:38.925974 9192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:59:38.926077 9192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:59:38.926183 9192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:59:38.926260 9192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:59:38.948817 9192 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:39979
I20260808 09:59:38.949477 9192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 09:59:38.949705 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 9192
I20260808 09:59:38.949810 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 09:59:38.950021 24863 external_mini_cluster.cc:1428] Setting key 14069c4eada743d69c21e18a841fae30
I20260808 09:59:38.960170 9399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:39979 every 8 connection(s)
Aug 08 09:59:38 dist-test-slave-gw5c krb5kdc[8303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183178, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
I20260808 09:59:38.979274 9405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:38.961053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35611 (local address 127.24.71.193:55951)
0808 09:59:38.965585 (+ 4532us) negotiation.cc:107] Waiting for socket to connect
0808 09:59:38.965646 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 09:59:38.966817 (+ 1171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:59:38.967459 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:59:38.967465 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:59:38.967989 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:59:38.968490 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:38.968498 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:38.969573 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:38.969574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:38.971072 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:38.971075 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:38.971679 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:38.971680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:38.971904 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:38.972728 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:59:38.972739 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:59:38.974979 (+ 2240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:59:38.977474 (+ 2495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:59:38.977482 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:59:38.977484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:59:38.977759 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:59:38.978007 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:59:38.978008 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:59:38.978008 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:59:38.978148 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:59:38.978470 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:59:38.978477 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:59:38.978653 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 09:59:38.978765 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 09:59:38.978929 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4451,"thread_start_us":272,"threads_started":1}
I20260808 09:59:38.979729 9407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:38.961586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:55951 (local address 127.24.71.254:35611)
0808 09:59:38.967097 (+ 5511us) server_negotiation.cc:206] Beginning negotiation
0808 09:59:38.967100 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:59:38.967110 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:59:38.967138 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:59:38.967139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:59:38.967153 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:59:38.967266 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:59:38.968619 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:38.969452 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:38.971180 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:38.971536 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:38.971602 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:38.975102 (+ 3500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:59:38.975103 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:59:38.975104 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:59:38.975113 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:59:38.977343 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:59:38.977864 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:59:38.977866 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:59:38.977866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:59:38.977936 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:59:38.978219 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:59:38.978220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:59:38.978220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:59:38.978377 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:59:38.978441 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 09:59:38.979529 (+ 1088us) server_negotiation.cc:299] Negotiation successful
0808 09:59:38.979621 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5427,"thread_start_us":144,"threads_started":1}
I20260808 09:59:38.980491 9401 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35611
I20260808 09:59:38.980602 9401 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
I20260808 09:59:38.980796 9401 heartbeater.cc:511] Master 127.24.71.254:35611 requested a full tablet report, sending...
I20260808 09:59:38.981380 9056 ts_manager.cc:194] Registered new tserver with Master: 969904832fbb4448872ce355ae7c2005 (127.24.71.193:39979)
I20260808 09:59:38.982342 9056 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:55951
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 09:59:39.003356 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.71.212:54915/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35611
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:59:39.185286 9411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:59:39.185567 9411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:59:39.185617 9411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:59:39.186997 9411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:59:39.187080 9411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:59:39.187137 9411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 09:59:39.189007 9411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.24.71.212:54915/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35611
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:59:39.189296 9411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:59:39.189620 9411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:59:39.197912 9426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:59:39.198009 9425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:59:39.198309 9428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:59:39.201061 9411 server_base.cc:1034] running on GCE node
I20260808 09:59:39.201344 9411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:59:39.201668 9411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:59:39.202867 9411 hybrid_clock.cc:648] HybridClock initialized: now 1786183179202845 us; error 51 us; skew 500 ppm
Aug 08 09:59:39 dist-test-slave-gw5c krb5kdc[8303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183179, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:59:39.206566 9411 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 09:59:39.207172 9411 webserver.cc:460] Webserver started at http://127.24.71.194:39419/ using document root <none> and password file <none>
I20260808 09:59:39.207485 9411 fs_manager.cc:359] Metadata directory not provided
I20260808 09:59:39.207615 9411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:59:39.207806 9411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 09:59:39 dist-test-slave-gw5c krb5kdc[8303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183179, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 09:59:39.226953 9411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "e8d9c17ced004948b7c8a6cfd82e104a"
format_stamp: "Formatted at 2026-08-08 09:59:39 on dist-test-slave-gw5c"
server_key: "078948ea83b82cfe3d51856841eda3eb"
server_key_iv: "705e25a77c9ec66dee31ab56ace7c9a1"
server_key_version: "kuduclusterkey@0"
I20260808 09:59:39.228569 9411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "e8d9c17ced004948b7c8a6cfd82e104a"
format_stamp: "Formatted at 2026-08-08 09:59:39 on dist-test-slave-gw5c"
server_key: "078948ea83b82cfe3d51856841eda3eb"
server_key_iv: "705e25a77c9ec66dee31ab56ace7c9a1"
server_key_version: "kuduclusterkey@0"
I20260808 09:59:39.230973 9411 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260808 09:59:39.250916 9440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:59:39.251252 9411 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.001s
I20260808 09:59:39.251385 9411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "e8d9c17ced004948b7c8a6cfd82e104a"
format_stamp: "Formatted at 2026-08-08 09:59:39 on dist-test-slave-gw5c"
server_key: "078948ea83b82cfe3d51856841eda3eb"
server_key_iv: "705e25a77c9ec66dee31ab56ace7c9a1"
server_key_version: "kuduclusterkey@0"
I20260808 09:59:39.251561 9411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 08 09:59:39 dist-test-slave-gw5c krb5kdc[8303](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786183179, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:59:39.277057 9411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:59:39.280006 9411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:59:39.280278 9411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:59:39.280779 9411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:59:39.281302 9411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:59:39.281389 9411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:59:39.281452 9411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:59:39.281498 9411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:59:39.299957 9411 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:35375
I20260808 09:59:39.300601 9411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 09:59:39.303651 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 9411
I20260808 09:59:39.303785 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 09:59:39.304071 24863 external_mini_cluster.cc:1428] Setting key 2da362c0a99206d4177baf426bc789c1
I20260808 09:59:39.311827 9618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:35375 every 8 connection(s)
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Aug 08 09:59:39 dist-test-slave-gw5c krb5kdc[8303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183179, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:59:39.340613 9407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.313570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:41147 (local address 127.24.71.254:35611)
0808 09:59:39.313625 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 09:59:39.313628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:59:39.319244 (+ 5616us) server_negotiation.cc:407] Connection header received
0808 09:59:39.327553 (+ 8309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:59:39.327556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:59:39.327581 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:59:39.327668 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:59:39.329159 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.330002 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.331920 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.332378 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.332433 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.336085 (+ 3652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:59:39.336087 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:59:39.336087 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:59:39.336097 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:59:39.338030 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:59:39.339085 (+ 1055us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:59:39.339087 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:59:39.339087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:59:39.339159 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:59:39.339552 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:59:39.339554 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:59:39.339554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:59:39.339734 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:59:39.339807 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 09:59:39.340306 (+ 499us) server_negotiation.cc:299] Negotiation successful
0808 09:59:39.340414 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 09:59:39.341710 9626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.313109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35611 (local address 127.24.71.194:41147)
0808 09:59:39.319011 (+ 5902us) negotiation.cc:107] Waiting for socket to connect
0808 09:59:39.319082 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 09:59:39.320310 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:59:39.327857 (+ 7547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:59:39.327863 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:59:39.328483 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:59:39.329024 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.329033 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.330149 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.330150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.331795 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.331799 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.332550 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.332551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.332785 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.333625 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:59:39.333637 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:59:39.335962 (+ 2325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:59:39.338158 (+ 2196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:59:39.338166 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:59:39.338169 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:59:39.338509 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:59:39.339265 (+ 756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:59:39.339265 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:59:39.339266 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:59:39.339463 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:59:39.339926 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:59:39.339935 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:59:39.340118 (+ 183us) client_negotiation.cc:769] Sending connection context
0808 09:59:39.341127 (+ 1009us) client_negotiation.cc:240] Negotiation successful
0808 09:59:39.341337 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5784,"thread_start_us":227,"threads_started":1}
I20260808 09:59:39.342545 9622 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35611
I20260808 09:59:39.342657 9622 heartbeater.cc:464] Registering TS with master...
I20260808 09:59:39.342842 9622 heartbeater.cc:511] Master 127.24.71.254:35611 requested a full tablet report, sending...
I20260808 09:59:39.343268 9056 ts_manager.cc:194] Registered new tserver with Master: e8d9c17ced004948b7c8a6cfd82e104a (127.24.71.194:35375)
I20260808 09:59:39.343818 9056 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:41147
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 09:59:39.347636 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.71.212:54915/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35611
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 09:59:39.503190 9628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 09:59:39.503749 9628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 09:59:39.503890 9628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 09:59:39.505966 9628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 09:59:39.506086 9628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 09:59:39.506151 9628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 09:59:39.508522 9628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.24.71.212:54915/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35611
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 09:59:39.508827 9628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 09:59:39.509126 9628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 09:59:39.518589 9642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:59:39.518584 9639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 09:59:39.519948 9648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 09:59:39.520807 9628 server_base.cc:1034] running on GCE node
I20260808 09:59:39.521039 9628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 09:59:39.521322 9628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 09:59:39.522504 9628 hybrid_clock.cc:648] HybridClock initialized: now 1786183179522481 us; error 35 us; skew 500 ppm
Aug 08 09:59:39 dist-test-slave-gw5c krb5kdc[8303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183179, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 09:59:39.528668 9628 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 09:59:39.529280 9628 webserver.cc:460] Webserver started at http://127.24.71.195:42811/ using document root <none> and password file <none>
I20260808 09:59:39.529624 9628 fs_manager.cc:359] Metadata directory not provided
I20260808 09:59:39.529740 9628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 09:59:39.529940 9628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 09:59:39 dist-test-slave-gw5c krb5kdc[8303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183179, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 09:59:39.554781 9628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "72b7177befa5439a8cec30d71b2d053b"
format_stamp: "Formatted at 2026-08-08 09:59:39 on dist-test-slave-gw5c"
server_key: "2a72c7471d2deb655d815a201db0701f"
server_key_iv: "a59488fb405ef6ceb905b68c35ba9006"
server_key_version: "kuduclusterkey@0"
I20260808 09:59:39.555419 9628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "72b7177befa5439a8cec30d71b2d053b"
format_stamp: "Formatted at 2026-08-08 09:59:39 on dist-test-slave-gw5c"
server_key: "2a72c7471d2deb655d815a201db0701f"
server_key_iv: "a59488fb405ef6ceb905b68c35ba9006"
server_key_version: "kuduclusterkey@0"
I20260808 09:59:39.567123 9628 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.001s sys 0.001s
I20260808 09:59:39.592504 9660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 09:59:39.592849 9628 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 09:59:39.592954 9628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "72b7177befa5439a8cec30d71b2d053b"
format_stamp: "Formatted at 2026-08-08 09:59:39 on dist-test-slave-gw5c"
server_key: "2a72c7471d2deb655d815a201db0701f"
server_key_iv: "a59488fb405ef6ceb905b68c35ba9006"
server_key_version: "kuduclusterkey@0"
I20260808 09:59:39.593088 9628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 09:59:39.611109 9628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 09:59:39.614614 9628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 09:59:39.614948 9628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 09:59:39.615353 9628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 09:59:39.616231 9628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 09:59:39.616328 9628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 09:59:39.616366 9628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 09:59:39.616456 9628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 09:59:39.640364 9628 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:42947
I20260808 09:59:39.641170 9831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:42947 every 8 connection(s)
I20260808 09:59:39.641611 9628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
Aug 08 09:59:39 dist-test-slave-gw5c krb5kdc[8303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183179, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 09:59:39.654592 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 9628
I20260808 09:59:39.654707 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 09:59:39.654894 24863 external_mini_cluster.cc:1428] Setting key 0058ed6d3707c14f77ab700a379a5a35
I20260808 09:59:39.659906 9407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.643539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:40215 (local address 127.24.71.254:35611)
0808 09:59:39.643621 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 09:59:39.643623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:59:39.643917 (+ 294us) server_negotiation.cc:407] Connection header received
0808 09:59:39.645249 (+ 1332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:59:39.645251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:59:39.645279 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:59:39.645372 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:59:39.646946 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.647787 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.649738 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.650037 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.650095 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.654191 (+ 4096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:59:39.654194 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:59:39.654194 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:59:39.654204 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:59:39.657653 (+ 3449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:59:39.658316 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:59:39.658317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:59:39.658318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:59:39.658389 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:59:39.658829 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:59:39.658830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:59:39.658831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:59:39.659056 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:59:39.659133 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 09:59:39.659676 (+ 543us) server_negotiation.cc:299] Negotiation successful
0808 09:59:39.659798 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 09:59:39.660858 9835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.643052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35611 (local address 127.24.71.195:40215)
0808 09:59:39.643672 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0808 09:59:39.643728 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 09:59:39.645061 (+ 1333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:59:39.645641 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:59:39.645657 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:59:39.646201 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 09:59:39.646750 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.646759 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.647973 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.647974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.649603 (+ 1629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.649608 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.650214 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.650215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.650474 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.651436 (+ 962us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 09:59:39.651447 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 09:59:39.654043 (+ 2596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 09:59:39.657835 (+ 3792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:59:39.657846 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:59:39.657849 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:59:39.658211 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:59:39.658499 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 09:59:39.658499 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 09:59:39.658500 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 09:59:39.658694 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 09:59:39.659238 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 09:59:39.659246 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 09:59:39.659482 (+ 236us) client_negotiation.cc:769] Sending connection context
0808 09:59:39.660321 (+ 839us) client_negotiation.cc:240] Negotiation successful
0808 09:59:39.660540 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":213,"threads_started":1}
I20260808 09:59:39.661625 9832 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35611
I20260808 09:59:39.661747 9832 heartbeater.cc:464] Registering TS with master...
I20260808 09:59:39.661995 9832 heartbeater.cc:511] Master 127.24.71.254:35611 requested a full tablet report, sending...
I20260808 09:59:39.662475 9056 ts_manager.cc:194] Registered new tserver with Master: 72b7177befa5439a8cec30d71b2d053b (127.24.71.195:42947)
I20260808 09:59:39.663028 9056 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:40215
I20260808 09:59:39.667610 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 09:59:39.680461 9407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.670616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59362 (local address 127.24.71.254:35611)
0808 09:59:39.670677 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 09:59:39.670680 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 09:59:39.671094 (+ 414us) server_negotiation.cc:407] Connection header received
0808 09:59:39.671151 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:59:39.671153 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:59:39.671166 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:59:39.671243 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 09:59:39.673022 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.673861 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.675035 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.675312 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.675372 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.677182 (+ 1810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 09:59:39.677183 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 09:59:39.677183 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 09:59:39.677191 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 09:59:39.678836 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:59:39.679254 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:59:39.679255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:59:39.679255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:59:39.679360 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 09:59:39.679852 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 09:59:39.679853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 09:59:39.679854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 09:59:39.679986 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 09:59:39.680061 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 09:59:39.680274 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 09:59:39.680369 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 09:59:39.682974 9056 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59362:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 09:59:39.685619 9056 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 09:59:39.701676 9859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.690970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:42947 (local address 127.0.0.1:41202)
0808 09:59:39.695732 (+ 4762us) negotiation.cc:107] Waiting for socket to connect
0808 09:59:39.695771 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 09:59:39.695881 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:59:39.696281 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:59:39.696284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:59:39.696288 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:59:39.696388 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.696390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.698088 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.698089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.699618 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.699620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.701358 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.701359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.701445 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.701460 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 09:59:39.701528 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 09:59:39.701580 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4722,"thread_start_us":98,"threads_started":1}
I20260808 09:59:39.702090 9862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.691976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41202 (local address 127.24.71.195:42947)
0808 09:59:39.695636 (+ 3660us) server_negotiation.cc:206] Beginning negotiation
0808 09:59:39.695642 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 09:59:39.695856 (+ 214us) server_negotiation.cc:407] Connection header received
0808 09:59:39.696026 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:59:39.696028 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:59:39.696048 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:59:39.696133 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:59:39.696506 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.697987 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.699893 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.701065 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.701139 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.701320 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 09:59:39.701896 (+ 576us) server_negotiation.cc:299] Negotiation successful
0808 09:59:39.701939 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3612,"thread_start_us":126,"threads_started":1}
I20260808 09:59:39.703059 9732 tablet_service.cc:1467] Processing CreateTablet for tablet 7fd6696b06424c708d3366cb806db8ad (DEFAULT_TABLE table=test-table [id=20c332d9825443fba7737c618afb4372]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:59:39.703586 9732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fd6696b06424c708d3366cb806db8ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:59:39.705986 9857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.691213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:35375 (local address 127.0.0.1:43216)
0808 09:59:39.696438 (+ 5225us) negotiation.cc:107] Waiting for socket to connect
0808 09:59:39.696449 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:59:39.696503 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:59:39.697360 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:59:39.697361 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:59:39.697362 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:59:39.697425 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.697426 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.699015 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.699016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.701641 (+ 2625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.701644 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.705661 (+ 4017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.705662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.705765 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.705770 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 09:59:39.705830 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 09:59:39.705877 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5152,"thread_start_us":79,"threads_started":1}
I20260808 09:59:39.707509 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.691381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:39979 (local address 127.0.0.1:60976)
0808 09:59:39.697034 (+ 5653us) negotiation.cc:107] Waiting for socket to connect
0808 09:59:39.697045 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 09:59:39.697103 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:59:39.699564 (+ 2461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:59:39.699565 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:59:39.699567 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:59:39.699604 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.699605 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.702161 (+ 2556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.702162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.703454 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.703457 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.707252 (+ 3795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.707254 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.707317 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.707322 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 09:59:39.707353 (+ 31us) client_negotiation.cc:240] Negotiation successful
0808 09:59:39.707426 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5606,"thread_start_us":95,"threads_started":1}
I20260808 09:59:39.707973 9863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.692197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60976 (local address 127.24.71.193:39979)
0808 09:59:39.696204 (+ 4007us) server_negotiation.cc:206] Beginning negotiation
0808 09:59:39.696208 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:59:39.697164 (+ 956us) server_negotiation.cc:407] Connection header received
0808 09:59:39.697204 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:59:39.697206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:59:39.697222 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:59:39.697288 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:59:39.699704 (+ 2416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.702034 (+ 2330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.705257 (+ 3223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.707128 (+ 1871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.707660 (+ 532us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.707731 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 09:59:39.707773 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 09:59:39.707830 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3969,"thread_start_us":47,"threads_started":1}
I20260808 09:59:39.708542 9860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.691660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43216 (local address 127.24.71.194:35375)
0808 09:59:39.696117 (+ 4457us) server_negotiation.cc:206] Beginning negotiation
0808 09:59:39.696121 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 09:59:39.696568 (+ 447us) server_negotiation.cc:407] Connection header received
0808 09:59:39.696662 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:59:39.696664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:59:39.696681 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:59:39.696765 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:59:39.697503 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.698894 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.703721 (+ 4827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.704856 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.704956 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.705196 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 09:59:39.708352 (+ 3156us) server_negotiation.cc:299] Negotiation successful
0808 09:59:39.708405 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4408,"thread_start_us":98,"threads_started":1}
I20260808 09:59:39.708913 9285 tablet_service.cc:1467] Processing CreateTablet for tablet 7fd6696b06424c708d3366cb806db8ad (DEFAULT_TABLE table=test-table [id=20c332d9825443fba7737c618afb4372]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:59:39.709336 9285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fd6696b06424c708d3366cb806db8ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:59:39.710024 9864 tablet_bootstrap.cc:492] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b: Bootstrap starting.
I20260808 09:59:39.711545 9864 tablet_bootstrap.cc:654] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b: Neither blocks nor log segments found. Creating new log.
I20260808 09:59:39.712080 9516 tablet_service.cc:1467] Processing CreateTablet for tablet 7fd6696b06424c708d3366cb806db8ad (DEFAULT_TABLE table=test-table [id=20c332d9825443fba7737c618afb4372]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 09:59:39.712785 9516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fd6696b06424c708d3366cb806db8ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 09:59:39.712846 9864 log.cc:824] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b: Log is configured to *not* fsync() on all Append() calls
I20260808 09:59:39.716049 9867 tablet_bootstrap.cc:492] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005: Bootstrap starting.
I20260808 09:59:39.718369 9867 tablet_bootstrap.cc:654] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005: Neither blocks nor log segments found. Creating new log.
I20260808 09:59:39.719645 9867 log.cc:824] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005: Log is configured to *not* fsync() on all Append() calls
I20260808 09:59:39.720201 9864 tablet_bootstrap.cc:492] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b: No bootstrap required, opened a new log
I20260808 09:59:39.720343 9864 ts_tablet_manager.cc:1397] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.003s
I20260808 09:59:39.721156 9867 tablet_bootstrap.cc:492] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005: No bootstrap required, opened a new log
I20260808 09:59:39.721272 9867 ts_tablet_manager.cc:1397] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.005s
I20260808 09:59:39.723701 9868 tablet_bootstrap.cc:492] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a: Bootstrap starting.
I20260808 09:59:39.724779 9864 raft_consensus.cc:348] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b7177befa5439a8cec30d71b2d053b" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42947 } } peers { permanent_uuid: "e8d9c17ced004948b7c8a6cfd82e104a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35375 } } peers { permanent_uuid: "969904832fbb4448872ce355ae7c2005" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 39979 } }
I20260808 09:59:39.724957 9864 raft_consensus.cc:374] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:59:39.724988 9864 raft_consensus.cc:729] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b7177befa5439a8cec30d71b2d053b, State: Initialized, Role: FOLLOWER
I20260808 09:59:39.725142 9864 consensus_queue.cc:260] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b7177befa5439a8cec30d71b2d053b" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42947 } } peers { permanent_uuid: "e8d9c17ced004948b7c8a6cfd82e104a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35375 } } peers { permanent_uuid: "969904832fbb4448872ce355ae7c2005" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 39979 } }
I20260808 09:59:39.725529 9864 ts_tablet_manager.cc:1428] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260808 09:59:39.725651 9832 heartbeater.cc:503] Master 127.24.71.254:35611 was elected leader, sending a full tablet report...
I20260808 09:59:39.725695 9868 tablet_bootstrap.cc:654] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a: Neither blocks nor log segments found. Creating new log.
I20260808 09:59:39.726680 9868 log.cc:824] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a: Log is configured to *not* fsync() on all Append() calls
I20260808 09:59:39.727681 9867 raft_consensus.cc:348] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b7177befa5439a8cec30d71b2d053b" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42947 } } peers { permanent_uuid: "e8d9c17ced004948b7c8a6cfd82e104a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35375 } } peers { permanent_uuid: "969904832fbb4448872ce355ae7c2005" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 39979 } }
I20260808 09:59:39.728022 9867 raft_consensus.cc:374] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:59:39.728116 9867 raft_consensus.cc:729] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 969904832fbb4448872ce355ae7c2005, State: Initialized, Role: FOLLOWER
I20260808 09:59:39.728322 9867 consensus_queue.cc:260] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b7177befa5439a8cec30d71b2d053b" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42947 } } peers { permanent_uuid: "e8d9c17ced004948b7c8a6cfd82e104a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35375 } } peers { permanent_uuid: "969904832fbb4448872ce355ae7c2005" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 39979 } }
I20260808 09:59:39.728524 9868 tablet_bootstrap.cc:492] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a: No bootstrap required, opened a new log
I20260808 09:59:39.728606 9868 ts_tablet_manager.cc:1397] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 09:59:39.728816 9867 ts_tablet_manager.cc:1428] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260808 09:59:39.729014 9401 heartbeater.cc:503] Master 127.24.71.254:35611 was elected leader, sending a full tablet report...
I20260808 09:59:39.732267 9868 raft_consensus.cc:348] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b7177befa5439a8cec30d71b2d053b" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42947 } } peers { permanent_uuid: "e8d9c17ced004948b7c8a6cfd82e104a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35375 } } peers { permanent_uuid: "969904832fbb4448872ce355ae7c2005" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 39979 } }
I20260808 09:59:39.732462 9868 raft_consensus.cc:374] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 09:59:39.732496 9868 raft_consensus.cc:729] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8d9c17ced004948b7c8a6cfd82e104a, State: Initialized, Role: FOLLOWER
I20260808 09:59:39.732617 9868 consensus_queue.cc:260] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b7177befa5439a8cec30d71b2d053b" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42947 } } peers { permanent_uuid: "e8d9c17ced004948b7c8a6cfd82e104a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35375 } } peers { permanent_uuid: "969904832fbb4448872ce355ae7c2005" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 39979 } }
I20260808 09:59:39.732973 9868 ts_tablet_manager.cc:1428] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260808 09:59:39.733184 9622 heartbeater.cc:503] Master 127.24.71.254:35611 was elected leader, sending a full tablet report...
W20260808 09:59:39.812888 9624 tablet.cc:2369] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 09:59:39.817016 9874 raft_consensus.cc:482] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 09:59:39.817235 9874 raft_consensus.cc:504] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b7177befa5439a8cec30d71b2d053b" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42947 } } peers { permanent_uuid: "e8d9c17ced004948b7c8a6cfd82e104a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35375 } } peers { permanent_uuid: "969904832fbb4448872ce355ae7c2005" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 39979 } }
I20260808 09:59:39.817874 9874 leader_election.cc:288] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72b7177befa5439a8cec30d71b2d053b (127.24.71.195:42947), e8d9c17ced004948b7c8a6cfd82e104a (127.24.71.194:35375)
I20260808 09:59:39.823326 9862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.818205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:34101 (local address 127.24.71.195:42947)
0808 09:59:39.818254 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 09:59:39.818256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:59:39.818899 (+ 643us) server_negotiation.cc:407] Connection header received
0808 09:59:39.819063 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:59:39.819064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:59:39.819082 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:59:39.819122 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:59:39.819637 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.820367 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.822422 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.822916 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.823019 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.823030 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 09:59:39.823208 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 09:59:39.823251 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 09:59:39.823427 9876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.818117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:42947 (local address 127.24.71.193:34101)
0808 09:59:39.818799 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0808 09:59:39.818814 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 09:59:39.818938 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:59:39.819230 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:59:39.819231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:59:39.819234 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:59:39.819519 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.819523 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.820570 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.820571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.822292 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.822295 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.823019 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.823020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.823119 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.823124 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 09:59:39.823201 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 09:59:39.823247 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"mutex_wait_us":21,"thread_start_us":139,"threads_started":1}
I20260808 09:59:39.823940 9860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.818486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:47445 (local address 127.24.71.194:35375)
0808 09:59:39.818530 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 09:59:39.818532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:59:39.820091 (+ 1559us) server_negotiation.cc:407] Connection header received
0808 09:59:39.820198 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:59:39.820199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:59:39.820212 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:59:39.820245 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 09:59:39.820733 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.821521 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.822729 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.823268 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.823368 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.823379 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 09:59:39.823814 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 09:59:39.823864 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 09:59:39.824095 9877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.818392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:35375 (local address 127.24.71.193:47445)
0808 09:59:39.820002 (+ 1610us) negotiation.cc:107] Waiting for socket to connect
0808 09:59:39.820015 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 09:59:39.820122 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 09:59:39.820310 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 09:59:39.820310 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 09:59:39.820312 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 09:59:39.820622 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.820626 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.821690 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.821691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.822614 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 09:59:39.822617 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.823456 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.823457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 09:59:39.823709 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.823714 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 09:59:39.823788 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 09:59:39.823832 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1536,"thread_start_us":167,"threads_started":1}
I20260808 09:59:39.824040 9770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fd6696b06424c708d3366cb806db8ad" candidate_uuid: "969904832fbb4448872ce355ae7c2005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b7177befa5439a8cec30d71b2d053b" is_pre_election: true
I20260808 09:59:39.824244 9770 raft_consensus.cc:2454] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 969904832fbb4448872ce355ae7c2005 in term 0.
I20260808 09:59:39.824600 9222 leader_election.cc:302] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b7177befa5439a8cec30d71b2d053b, 969904832fbb4448872ce355ae7c2005; no voters:
I20260808 09:59:39.824756 9546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fd6696b06424c708d3366cb806db8ad" candidate_uuid: "969904832fbb4448872ce355ae7c2005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8d9c17ced004948b7c8a6cfd82e104a" is_pre_election: true
I20260808 09:59:39.824790 9874 raft_consensus.cc:2781] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 09:59:39.824873 9874 raft_consensus.cc:482] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 09:59:39.824909 9874 raft_consensus.cc:3037] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:59:39.824934 9546 raft_consensus.cc:2454] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 969904832fbb4448872ce355ae7c2005 in term 0.
I20260808 09:59:39.826328 9874 raft_consensus.cc:504] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b7177befa5439a8cec30d71b2d053b" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42947 } } peers { permanent_uuid: "e8d9c17ced004948b7c8a6cfd82e104a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35375 } } peers { permanent_uuid: "969904832fbb4448872ce355ae7c2005" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 39979 } }
I20260808 09:59:39.826478 9874 leader_election.cc:288] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [CANDIDATE]: Term 1 election: Requested vote from peers 72b7177befa5439a8cec30d71b2d053b (127.24.71.195:42947), e8d9c17ced004948b7c8a6cfd82e104a (127.24.71.194:35375)
I20260808 09:59:39.826813 9770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fd6696b06424c708d3366cb806db8ad" candidate_uuid: "969904832fbb4448872ce355ae7c2005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b7177befa5439a8cec30d71b2d053b"
I20260808 09:59:39.826833 9546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fd6696b06424c708d3366cb806db8ad" candidate_uuid: "969904832fbb4448872ce355ae7c2005" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8d9c17ced004948b7c8a6cfd82e104a"
I20260808 09:59:39.826905 9770 raft_consensus.cc:3037] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:59:39.826916 9546 raft_consensus.cc:3037] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a [term 0 FOLLOWER]: Advancing to term 1
I20260808 09:59:39.828423 9546 raft_consensus.cc:2454] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 969904832fbb4448872ce355ae7c2005 in term 1.
I20260808 09:59:39.828632 9222 leader_election.cc:302] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 969904832fbb4448872ce355ae7c2005, e8d9c17ced004948b7c8a6cfd82e104a; no voters:
I20260808 09:59:39.828687 9770 raft_consensus.cc:2454] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 969904832fbb4448872ce355ae7c2005 in term 1.
I20260808 09:59:39.828715 9874 raft_consensus.cc:2781] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 09:59:39.828855 9874 raft_consensus.cc:686] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [term 1 LEADER]: Becoming Leader. State: Replica: 969904832fbb4448872ce355ae7c2005, State: Running, Role: LEADER
I20260808 09:59:39.828944 9874 consensus_queue.cc:237] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b7177befa5439a8cec30d71b2d053b" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42947 } } peers { permanent_uuid: "e8d9c17ced004948b7c8a6cfd82e104a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35375 } } peers { permanent_uuid: "969904832fbb4448872ce355ae7c2005" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 39979 } }
I20260808 09:59:39.829830 9056 catalog_manager.cc:5495] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 reported cstate change: term changed from 0 to 1, leader changed from <none> to 969904832fbb4448872ce355ae7c2005 (127.24.71.193). New cstate: current_term: 1 leader_uuid: "969904832fbb4448872ce355ae7c2005" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b7177befa5439a8cec30d71b2d053b" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8d9c17ced004948b7c8a6cfd82e104a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "969904832fbb4448872ce355ae7c2005" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 39979 } health_report { overall_health: HEALTHY } } }
I20260808 09:59:39.847702 9863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.843899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60990 (local address 127.24.71.193:39979)
0808 09:59:39.843972 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 09:59:39.843974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 09:59:39.843984 (+ 10us) server_negotiation.cc:407] Connection header received
0808 09:59:39.844031 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 09:59:39.844032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 09:59:39.844058 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 09:59:39.844144 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 09:59:39.844586 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.845313 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.846467 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 09:59:39.846767 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 09:59:39.846859 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 09:59:39.847070 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 09:59:39.847229 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 09:59:39.847329 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 09:59:39.847415 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 09:59:39.847455 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 09:59:39.850823 9546 raft_consensus.cc:1261] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a [term 1 FOLLOWER]: Refusing update from remote peer 969904832fbb4448872ce355ae7c2005: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:59:39.850858 9770 raft_consensus.cc:1261] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b [term 1 FOLLOWER]: Refusing update from remote peer 969904832fbb4448872ce355ae7c2005: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 09:59:39.851254 9874 consensus_queue.cc:1035] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b7177befa5439a8cec30d71b2d053b" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 42947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:59:39.851532 9878 consensus_queue.cc:1035] T 7fd6696b06424c708d3366cb806db8ad P 969904832fbb4448872ce355ae7c2005 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8d9c17ced004948b7c8a6cfd82e104a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 09:59:39.855278 9882 mvcc.cc:205] Tried to move back new op lower bound from 7316206304665067520 to 7316206304579969024. Current Snapshot: MvccSnapshot[applied={T|T < 7316206304665067520}]
I20260808 09:59:39.856087 9883 mvcc.cc:205] Tried to move back new op lower bound from 7316206304665067520 to 7316206304579969024. Current Snapshot: MvccSnapshot[applied={T|T < 7316206304665067520}]
I20260808 09:59:39.858140 9884 mvcc.cc:205] Tried to move back new op lower bound from 7316206304665067520 to 7316206304579969024. Current Snapshot: MvccSnapshot[applied={T|T < 7316206304665067520}]
I20260808 09:59:39.861622 9056 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:59:39.861784 9056 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 09:59:39.862722 9056 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5f39025c6e85447595ecdf042c4d3369: Sending DeleteTablet for 3 replicas of tablet 7fd6696b06424c708d3366cb806db8ad
I20260808 09:59:39.863307 9516 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fd6696b06424c708d3366cb806db8ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:59:39 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:43216
I20260808 09:59:39.863536 9732 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fd6696b06424c708d3366cb806db8ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:59:39 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:41202
I20260808 09:59:39.863929 9285 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fd6696b06424c708d3366cb806db8ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 09:59:39 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:60976
I20260808 09:59:39.864612 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 9192
I20260808 09:59:39.873646 9894 tablet_replica.cc:330] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b: stopping tablet replica
I20260808 09:59:39.873842 9894 raft_consensus.cc:2229] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:59:39.874015 9894 raft_consensus.cc:2258] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 09:59:39.874607 9894 ts_tablet_manager.cc:1905] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:59:39.877360 9894 ts_tablet_manager.cc:1918] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 09:59:39.877532 9894 log.cc:1196] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/7fd6696b06424c708d3366cb806db8ad
I20260808 09:59:39.878419 9894 ts_tablet_manager.cc:1939] T 7fd6696b06424c708d3366cb806db8ad P 72b7177befa5439a8cec30d71b2d053b: Deleting consensus metadata
I20260808 09:59:39.879061 9033 catalog_manager.cc:4841] TS 72b7177befa5439a8cec30d71b2d053b (127.24.71.195:42947): tablet 7fd6696b06424c708d3366cb806db8ad (table test-table [id=20c332d9825443fba7737c618afb4372]) successfully deleted
I20260808 09:59:39.879328 9893 tablet_replica.cc:330] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a: stopping tablet replica
I20260808 09:59:39.879501 9893 raft_consensus.cc:2229] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 09:59:39.879665 9893 raft_consensus.cc:2258] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 09:59:39.880944 9033 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:39979 (error 108)
I20260808 09:59:39.881150 9893 ts_tablet_manager.cc:1905] T 7fd6696b06424c708d3366cb806db8ad P e8d9c17ced004948b7c8a6cfd82e104a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 09:59:39.881865 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.881743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:39979 (local address 127.0.0.1:32768)
0808 09:59:39.881793 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 09:59:39.881828 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:39979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 09:59:39.881990 9033 catalog_manager.cc:4584] TS 969904832fbb4448872ce355ae7c2005 (127.24.71.193:39979): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7fd6696b06424c708d3366cb806db8ad: Network error: Client connection negotiation failed: client connection to 127.24.71.193:39979: connect: Connection refused (error 111)
I20260808 09:59:39.882197 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 9411
I20260808 09:59:39.892506 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 9628
I20260808 09:59:39.892608 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 09:59:39.892461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:35375 (local address 127.0.0.1:43220)
0808 09:59:39.892538 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 09:59:39.892566 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.194:35375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 09:59:39.914930 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 9001
I20260808 09:59:39.931233 24863 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 09:59:40.288511 24863 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 09:59:40.288671 24863 mini_ranger.cc:66] Stopping Ranger...
I20260808 09:59:40.633817 24863 mini_ranger.cc:68] Stopped Ranger
2026-08-08 09:59:40.634 UTC [8341] LOG: received smart shutdown request
2026-08-08 09:59:40.637 UTC [8341] LOG: background worker "logical replication launcher" (PID 8356) exited with exit code 1
2026-08-08 09:59:40.638 UTC [8349] LOG: shutting down
2026-08-08 09:59:40.810 UTC [8341] LOG: database system is shut down
2026-08-08T09:59:40Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49657 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 09:59:40 dist-test-slave-gw5c krb5kdc[9917](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 09:59:40 dist-test-slave-gw5c krb5kdc[9917](info): set up 2 sockets
Aug 08 09:59:40 dist-test-slave-gw5c krb5kdc[9917](info): commencing operation
krb5kdc: starting...
W20260808 09:59:42.205663 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 09:59:42 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T09:59:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T09:59:42Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.24.71.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.24.71.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/rangeradmin_127.24.71.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/rangeradmin_127.24.71.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.24.71.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.24.71.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/rangerlookup_127.24.71.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/rangerlookup_127.24.71.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.71.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.24.71.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/HTTP_127.24.71.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/HTTP_127.24.71.212@KRBTEST.COM.keytab.
I20260808 09:59:42.380299 24863 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskzT1q8T/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/postgres -l logfile start
2026-08-08 09:59:44.959 UTC [9969] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 09:59:44.960 UTC [9969] LOG: listening on IPv4 address "127.24.71.212", port 38409
2026-08-08 09:59:44.963 UTC [9969] LOG: listening on Unix socket "/tmp/.s.PGSQL.38409"
2026-08-08 09:59:44.985 UTC [9974] LOG: database system was shut down at 2026-08-08 09:59:43 UTC
2026-08-08 09:59:44.989 UTC [9969] LOG: database system is ready to accept connections
I20260808 09:59:46.147320 24863 mini_postgres.cc:96] Postgres bound to 38409
2026-08-08 09:59:46.154 UTC [9983] FATAL: database "slave" does not exist
127.24.71.212:38409 - accepting connections
I20260808 09:59:46.155529 24863 mini_ranger.cc:161] Starting Ranger...
I20260808 09:59:46.171650 24863 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 09:59:46.644601 24863 mini_ranger.cc:87] Created ranger Postgres database
I20260808 09:59:46.644693 24863 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-admin
2026-08-08 09:59:46,910 [I] DB FLAVOR :POSTGRES
2026-08-08 09:59:46,910 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 09:59:46,911 [I] Checking connection..
2026-08-08 09:59:46,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 09:59:47,187 [I] Checking connection passed.
2026-08-08 09:59:47,188 [I] --------- Verifying version history table ---------
2026-08-08 09:59:47,188 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 09:59:47,449 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 09:59:47,450 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 09:59:47,730 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 09:59:47,730 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 09:59:47,730 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 09:59:47.965 UTC [10086] WARNING: there is no transaction in progress
2026-08-08 09:59:47,975 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 09:59:47,976 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 09:59:48,252 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 09:59:48,252 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 09:59:48,253 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 09:59:48,507 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 09:59:48,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gw5c.c.gcp-upstream.internal','N') ;"
2026-08-08 09:59:49,002 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 09:59:49,270 [I] Table x_portal_user does not exist in database ranger
2026-08-08 09:59:49,271 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 09:59:49,545 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 09:59:49,546 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 09:59:49,803 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 09:59:50,079 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 09:59:50,080 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 09:59:51.054 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.071 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.088 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.103 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.118 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.136 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.198 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.205 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.219 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.230 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.241 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.254 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.264 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.270 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.276 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51.282 UTC [10267] WARNING: there is no transaction in progress
2026-08-08 09:59:51,931 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 09:59:51,931 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 09:59:52,191 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 09:59:52,191 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 09:59:52,463 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 09:59:52,464 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 09:59:52,750 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 09:59:52,750 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 09:59:53,030 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 09:59:53,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gw5c.c.gcp-upstream.internal';"
2026-08-08 09:59:53,572 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 09:59:53,572 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 09:59:53,847 [I] DB_PATCHES have already been applied
I20260808 09:59:53.853139 24863 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-admin:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskzT1q8T/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 09:59:53.853209 24863 mini_ranger.cc:193] Using host: 127.24.71.212
I20260808 09:59:53.857106 24863 mini_ranger.cc:227] Ranger admin URL: http://127.24.71.212:41931
Aug 08, 2026 9:59:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 9:59:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 9:59:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 9:59:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 9:59:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 9:59:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 9:59:54 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 09:59:55.245918 24863 mini_ranger.cc:160] Time spent starting Ranger: real 9.090s user 0.000s sys 0.010s
Aug 08, 2026 10:00:16 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 10:00:16 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 10:00:16 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 10:00:16 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 10:00:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 10:00:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 10:00:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 10:00:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 10:00:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 10:00:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 10:00:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 10:00:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 10:00:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 10:00:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 10:00:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 10:00:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 10:00:16 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 10:00:17 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 10:00:18.236613 24863 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.24.71.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.24.71.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/rangerkms_127.24.71.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.24.71.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/rangerkms_127.24.71.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.71.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.24.71.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.71.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/HTTP_127.24.71.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.71.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/HTTP_127.24.71.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 10:00:18 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183218, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 10:00:18.323060 24863 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 10:00:18.333797 24863 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 10:00:19.171448 24863 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 10:00:19.171541 24863 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-kms
I20260808 10:00:19.171566 24863 mini_ranger_kms.cc:227] Using postgres at 127.24.71.212:38409
2026-08-08 10:00:19,449 [I] DB FLAVOR :POSTGRES
2026-08-08 10:00:19,449 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 10:00:19,449 [I] Checking connection
2026-08-08 10:00:19,449 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 10:00:19,760 [I] connection success
2026-08-08 10:00:19,761 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 10:00:19,761 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 10:00:19,761 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 10:00:20,019 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 10:00:20,019 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 10:00:20,019 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 10:00:20,020 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.71.212:38409/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 10:00:20,284 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 10:00:20.845641 24863 mini_ranger_kms.cc:310] Created kms service
I20260808 10:00:21.055385 24863 mini_ranger_kms.cc:326] Created kudu user
I20260808 10:00:21.100522 24863 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 10:00:21 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183218, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 10:00:21.494882 24863 mini_ranger_kms.cc:384] Added ranger policy
I20260808 10:00:21.495127 24863 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-kms:/tmp/dist-test-taskzT1q8T/build/release/bin/postgresql.jar:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskzT1q8T/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 10:00:21.495150 24863 mini_ranger_kms.cc:240] Using host: 127.24.71.212
I20260808 10:00:21.500010 24863 mini_ranger_kms.cc:276] Ranger KMS PID: 10573
I20260808 10:00:21.500116 24863 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.24.71.212:35637
Aug 08, 2026 10:00:22 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 10:00:22 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 10:00:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 10:00:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 10:00:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 10:00:23 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 10:00:23 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786183223, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.71.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:24.271806 24863 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.949s user 0.008s sys 0.232s
I20260808 10:00:24.271922 24863 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 10:00:24.271973 24863 mini_ranger_kms.cc:401] 127.24.71.212:35637/kms/v1/keys
Aug 08 10:00:24 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183223, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.71.212@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
Aug 08 10:00:24 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183223, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.71.212@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
Aug 08 10:00:26 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:00:26.978263 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33039
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:33039
--ranger_config_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.71.212:35637/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:27.062770 10653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:27.062983 10653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:27.063005 10653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:27.064308 10653 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:00:27.064354 10653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:27.064368 10653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:27.064381 10653 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:00:27.064393 10653 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:00:27.065984 10653 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/wal
--ranger_kms_url=127.24.71.212:35637/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:33039
--ranger_config_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:27.066229 10653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:27.066504 10653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:27.071524 10663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:27.071570 10660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:27.071596 10653 server_base.cc:1034] running on GCE node
W20260808 10:00:27.071872 10665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:27.072141 10653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:27.072448 10653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:27.073611 10653 hybrid_clock.cc:648] HybridClock initialized: now 1786183227073589 us; error 39 us; skew 500 ppm
Aug 08 10:00:27 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183227, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:27.076189 10653 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:00:27.076668 10653 webserver.cc:460] Webserver started at http://127.24.71.254:35665/ using document root <none> and password file <none>
I20260808 10:00:27.076905 10653 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:27.076944 10653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:27.077081 10653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 10:00:27 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183227, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 10:00:27.124807 10653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "c97140e55f9a4e95bcb7ebf2f50dd463"
format_stamp: "Formatted at 2026-08-08 10:00:27 on dist-test-slave-gw5c"
server_key: "a22f63cb122edd7a05304e387840a371"
server_key_iv: "0696809a609155190eb1635d08c5f992"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:27.125253 10653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "c97140e55f9a4e95bcb7ebf2f50dd463"
format_stamp: "Formatted at 2026-08-08 10:00:27 on dist-test-slave-gw5c"
server_key: "a22f63cb122edd7a05304e387840a371"
server_key_iv: "0696809a609155190eb1635d08c5f992"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:27.126866 10653 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 10:00:27.140100 10673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:27.140329 10653 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 10:00:27.140440 10653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "c97140e55f9a4e95bcb7ebf2f50dd463"
format_stamp: "Formatted at 2026-08-08 10:00:27 on dist-test-slave-gw5c"
server_key: "a22f63cb122edd7a05304e387840a371"
server_key_iv: "0696809a609155190eb1635d08c5f992"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:27.140552 10653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:27.153406 10653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:27.155604 10653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:27.155777 10653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:27.160697 10653 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:33039
I20260808 10:00:27.160727 10747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:33039 every 8 connection(s)
I20260808 10:00:27.161089 10653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:00:27.161837 10751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:27.164248 10751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463: Bootstrap starting.
I20260808 10:00:27.164836 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 10653
I20260808 10:00:27.164886 10751 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:27.164960 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:00:27.165139 24863 external_mini_cluster.cc:1428] Setting key 880549e13804f7502f1a6412526a895b
I20260808 10:00:27.165194 10751 log.cc:824] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:27.166014 10751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463: No bootstrap required, opened a new log
I20260808 10:00:27.168534 10751 raft_consensus.cc:348] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33039 } }
I20260808 10:00:27.168697 10751 raft_consensus.cc:374] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:27.168745 10751 raft_consensus.cc:729] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c97140e55f9a4e95bcb7ebf2f50dd463, State: Initialized, Role: FOLLOWER
I20260808 10:00:27.168879 10751 consensus_queue.cc:260] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33039 } }
I20260808 10:00:27.168984 10751 raft_consensus.cc:388] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:00:27.169041 10751 raft_consensus.cc:482] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:00:27.169119 10751 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:27.169694 10751 raft_consensus.cc:504] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33039 } }
I20260808 10:00:27.169824 10751 leader_election.cc:302] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c97140e55f9a4e95bcb7ebf2f50dd463; no voters:
I20260808 10:00:27.170024 10751 leader_election.cc:288] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:00:27.170058 10758 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:00:27.170275 10758 raft_consensus.cc:686] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 1 LEADER]: Becoming Leader. State: Replica: c97140e55f9a4e95bcb7ebf2f50dd463, State: Running, Role: LEADER
I20260808 10:00:27.170403 10751 sys_catalog.cc:564] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:00:27.170424 10758 consensus_queue.cc:237] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33039 } }
I20260808 10:00:27.170826 10758 sys_catalog.cc:455] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33039 } } }
I20260808 10:00:27.170991 10758 sys_catalog.cc:458] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:27.171187 10758 sys_catalog.cc:455] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c97140e55f9a4e95bcb7ebf2f50dd463. Latest consensus state: current_term: 1 leader_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33039 } } }
I20260808 10:00:27.171298 10758 sys_catalog.cc:458] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:27.171482 10770 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:00:27.172036 10770 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:00:27.172348 10751 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 08 10:00:27 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:27.173592 10786 mvcc.cc:205] Tried to move back new op lower bound from 7316206498501386240 to 7316206498490728448. Current Snapshot: MvccSnapshot[applied={T|T < 7316206498501386240}]
I20260808 10:00:27.175822 10770 catalog_manager.cc:1347] Generated new cluster ID: 9e8652dc627f4e90ad376bce80589306
I20260808 10:00:27.175884 10770 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:00:27.177747 10755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:27.165710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52412 (local address 127.24.71.254:33039)
0808 10:00:27.165891 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:27.165901 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:27.165944 (+ 43us) server_negotiation.cc:407] Connection header received
0808 10:00:27.166517 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:27.166526 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:27.166589 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:27.166745 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:27.167572 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:27.168995 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:27.170132 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:27.170770 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:27.170871 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:27.174128 (+ 3257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:27.174133 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:27.174133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:27.174147 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:27.176162 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:27.176560 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:27.176563 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:27.176564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:27.176667 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:27.176863 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:27.176863 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:27.176864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:27.177181 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:27.177331 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:27.177424 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 10:00:27.177546 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
I20260808 10:00:27.190461 10770 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:00:27.191428 10770 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:00:27.202999 10770 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463: Generated new TSK 0
I20260808 10:00:27.203284 10770 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 10:00:27.971169 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.71.212:35637/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33039
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:28.102978 10820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:28.103456 10820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:28.103561 10820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:28.105525 10820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:28.105667 10820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:28.105772 10820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:00:28.108240 10820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.24.71.212:35637/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:28.108790 10820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:28.109184 10820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:28.119208 10831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:28.119285 10827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:28.119692 10826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:28.120656 10820 server_base.cc:1034] running on GCE node
I20260808 10:00:28.121007 10820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:28.121306 10820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:28.122486 10820 hybrid_clock.cc:648] HybridClock initialized: now 1786183228122463 us; error 35 us; skew 500 ppm
Aug 08 10:00:28 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183228, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:28.125626 10820 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 10:00:28.126253 10820 webserver.cc:460] Webserver started at http://127.24.71.193:40373/ using document root <none> and password file <none>
I20260808 10:00:28.126538 10820 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:28.126619 10820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:28.126765 10820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 10:00:28 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183228, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 10:00:28.142669 10820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "0db919a3b31f4ecf887fc7aef8e04be4"
format_stamp: "Formatted at 2026-08-08 10:00:28 on dist-test-slave-gw5c"
server_key: "bc94e9506705fab0bfbfb39f0e90025e"
server_key_iv: "193c07510548579c13c9ab356efd65be"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:28.143250 10820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "0db919a3b31f4ecf887fc7aef8e04be4"
format_stamp: "Formatted at 2026-08-08 10:00:28 on dist-test-slave-gw5c"
server_key: "bc94e9506705fab0bfbfb39f0e90025e"
server_key_iv: "193c07510548579c13c9ab356efd65be"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:28.145272 10820 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260808 10:00:28.159621 10840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:28.159960 10820 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:00:28.160157 10820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "0db919a3b31f4ecf887fc7aef8e04be4"
format_stamp: "Formatted at 2026-08-08 10:00:28 on dist-test-slave-gw5c"
server_key: "bc94e9506705fab0bfbfb39f0e90025e"
server_key_iv: "193c07510548579c13c9ab356efd65be"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:28.160363 10820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:28.190917 10820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:28.193450 10820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:28.193671 10820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:28.194005 10820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:28.194444 10820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:28.194540 10820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:28.194640 10820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:28.194717 10820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:28.203086 10820 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:37033
I20260808 10:00:28.203673 10820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 10:00:28.204195 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 10820
I20260808 10:00:28.204308 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 10:00:28.204533 24863 external_mini_cluster.cc:1428] Setting key 96bec37a4d2fd09a959599b524ba2874
Aug 08 10:00:28 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183228, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:28.216198 11010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:37033 every 8 connection(s)
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
I20260808 10:00:28.218926 11016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:28.206187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:37691 (local address 127.24.71.254:33039)
0808 10:00:28.206356 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:28.206359 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:28.207702 (+ 1343us) server_negotiation.cc:407] Connection header received
0808 10:00:28.208546 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:28.208548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:28.208566 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:28.208608 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:28.209295 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:28.210103 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:28.211771 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:28.212235 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:28.212341 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:28.215306 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:28.215308 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:28.215309 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:28.215318 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:28.217278 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:28.217798 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:28.217800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:28.217800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:28.217869 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:28.218155 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:28.218156 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:28.218157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:28.218290 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:28.218367 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:28.218731 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 10:00:28.218826 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":57,"threads_started":1}
I20260808 10:00:28.219152 11013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:28.205884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33039 (local address 127.24.71.193:37691)
0808 10:00:28.207551 (+ 1667us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:28.207610 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:28.208406 (+ 796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:28.208784 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:28.208788 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:28.208999 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:28.209195 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:28.209199 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:28.210229 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:28.210230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:28.211663 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:28.211667 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:28.212467 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:28.212468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:28.212642 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:28.213274 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:28.213286 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:28.215157 (+ 1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:28.217370 (+ 2213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:28.217377 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:28.217379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:28.217708 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:28.217948 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:28.217949 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:28.217950 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:28.218080 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:28.218367 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:28.218376 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:28.218527 (+ 151us) client_negotiation.cc:769] Sending connection context
0808 10:00:28.218643 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 10:00:28.218820 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1612,"thread_start_us":93,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
I20260808 10:00:28.219789 11011 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33039
I20260808 10:00:28.219887 11011 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:28.220093 11011 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
I20260808 10:00:28.220731 10699 ts_manager.cc:194] Registered new tserver with Master: 0db919a3b31f4ecf887fc7aef8e04be4 (127.24.71.193:37033)
I20260808 10:00:28.221612 10699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:37691
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 10:00:28.236824 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.71.212:35637/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33039
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:28.364732 11021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:28.365111 11021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:28.365211 11021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:28.367242 11021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:28.367376 11021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:28.367501 11021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:00:28.369761 11021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.24.71.212:35637/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:28.370271 11021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:28.370667 11021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:28.377784 11036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:28.377789 11034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:28.377939 11033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:28.379557 11021 server_base.cc:1034] running on GCE node
I20260808 10:00:28.379915 11021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:28.380210 11021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:28.381394 11021 hybrid_clock.cc:648] HybridClock initialized: now 1786183228381376 us; error 37 us; skew 500 ppm
Aug 08 10:00:28 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183228, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:28.384883 11021 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 10:00:28.385490 11021 webserver.cc:460] Webserver started at http://127.24.71.194:38117/ using document root <none> and password file <none>
I20260808 10:00:28.385807 11021 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:28.385916 11021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:28.386092 11021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 10:00:28 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183228, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 10:00:28.406877 11021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "5238dcebe25943e1b76bd6beea0f6c52"
format_stamp: "Formatted at 2026-08-08 10:00:28 on dist-test-slave-gw5c"
server_key: "82d191b3d63353425a8299b33b649d34"
server_key_iv: "4eb4064e128d5a0dd9f405a738c33b43"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:28.407456 11021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "5238dcebe25943e1b76bd6beea0f6c52"
format_stamp: "Formatted at 2026-08-08 10:00:28 on dist-test-slave-gw5c"
server_key: "82d191b3d63353425a8299b33b649d34"
server_key_iv: "4eb4064e128d5a0dd9f405a738c33b43"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:28.412549 11021 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.002s
I20260808 10:00:28.432691 11052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:28.433002 11021 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260808 10:00:28.433106 11021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "5238dcebe25943e1b76bd6beea0f6c52"
format_stamp: "Formatted at 2026-08-08 10:00:28 on dist-test-slave-gw5c"
server_key: "82d191b3d63353425a8299b33b649d34"
server_key_iv: "4eb4064e128d5a0dd9f405a738c33b43"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:28.433209 11021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 08 10:00:28 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786183228, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:28.461072 11021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:28.463845 11021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:28.464088 11021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:28.464416 11021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:28.464895 11021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:28.465019 11021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:28.465104 11021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:28.465173 11021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:28.474470 11021 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:41191
I20260808 10:00:28.475019 11021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 10:00:28.478238 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 11021
I20260808 10:00:28.478371 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 10:00:28.478565 24863 external_mini_cluster.cc:1428] Setting key a8fbbb99fc19796870a8b399114eb71e
I20260808 10:00:28.476060 11240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:41191 every 8 connection(s)
Aug 08 10:00:28 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183228, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:28.489609 11016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:28.477622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:53421 (local address 127.24.71.254:33039)
0808 10:00:28.477678 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:28.477680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:28.478035 (+ 355us) server_negotiation.cc:407] Connection header received
0808 10:00:28.478829 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:28.478831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:28.478852 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:28.478890 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:28.480004 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:28.480773 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:28.482425 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:28.482724 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:28.482775 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:28.485664 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:28.485666 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:28.485666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:28.485676 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:28.487702 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:28.488334 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:28.488336 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:28.488336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:28.488412 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:28.488750 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:28.488751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:28.488751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:28.488907 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:28.488961 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:28.489399 (+ 438us) server_negotiation.cc:299] Negotiation successful
0808 10:00:28.489503 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 10:00:28.490471 11243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:28.477299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33039 (local address 127.24.71.194:53421)
0808 10:00:28.477887 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:28.477937 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:28.478676 (+ 739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:28.479118 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:28.479123 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:28.479492 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:28.479797 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:28.479805 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:28.480991 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:28.480992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:28.482299 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:28.482302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:28.482897 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:28.482899 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:28.483052 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:28.483764 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:28.483776 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:28.485563 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:28.487819 (+ 2256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:28.487827 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:28.487830 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:28.488176 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:28.488496 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:28.488498 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:28.488498 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:28.488654 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:28.489018 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:28.489026 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:28.489199 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 10:00:28.490001 (+ 802us) client_negotiation.cc:240] Negotiation successful
0808 10:00:28.490195 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":102,"threads_started":1}
I20260808 10:00:28.491241 11241 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33039
I20260808 10:00:28.491348 11241 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:28.491616 11241 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
I20260808 10:00:28.492100 10699 ts_manager.cc:194] Registered new tserver with Master: 5238dcebe25943e1b76bd6beea0f6c52 (127.24.71.194:41191)
I20260808 10:00:28.492602 10699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:53421
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 10:00:28.527004 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.71.212:35637/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33039
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:28.651614 11248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:28.651949 11248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:28.651997 11248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:28.653798 11248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:28.653911 11248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:28.653977 11248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:00:28.656270 11248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.24.71.212:35637/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:28.656689 11248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:28.657027 11248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:28.664235 11257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:28.664400 11262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:28.664229 11256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:28.665457 11248 server_base.cc:1034] running on GCE node
I20260808 10:00:28.665763 11248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:28.666101 11248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:28.667299 11248 hybrid_clock.cc:648] HybridClock initialized: now 1786183228667276 us; error 40 us; skew 500 ppm
Aug 08 10:00:28 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183228, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:28.674472 11248 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 10:00:28.675194 11248 webserver.cc:460] Webserver started at http://127.24.71.195:38971/ using document root <none> and password file <none>
I20260808 10:00:28.675505 11248 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:28.675585 11248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:28.675806 11248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 10:00:28 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183228, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 10:00:28.709898 11248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "53ad800ed24a4d53b5fe575cf87e6177"
format_stamp: "Formatted at 2026-08-08 10:00:28 on dist-test-slave-gw5c"
server_key: "bcde42e96f8a4f94e15d55dc930156fc"
server_key_iv: "a134ee0433ceb3f856eacbcc5687f8a9"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:28.710531 11248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "53ad800ed24a4d53b5fe575cf87e6177"
format_stamp: "Formatted at 2026-08-08 10:00:28 on dist-test-slave-gw5c"
server_key: "bcde42e96f8a4f94e15d55dc930156fc"
server_key_iv: "a134ee0433ceb3f856eacbcc5687f8a9"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:28.712649 11248 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260808 10:00:28.731019 11275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:28.731828 11248 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260808 10:00:28.731963 11248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "53ad800ed24a4d53b5fe575cf87e6177"
format_stamp: "Formatted at 2026-08-08 10:00:28 on dist-test-slave-gw5c"
server_key: "bcde42e96f8a4f94e15d55dc930156fc"
server_key_iv: "a134ee0433ceb3f856eacbcc5687f8a9"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:28.732076 11248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:28.745545 11248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:28.747989 11248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:28.748227 11248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:28.748504 11248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:28.748890 11248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:28.748950 11248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:28.749018 11248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:28.749047 11248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:28.756597 11248 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:43979
I20260808 10:00:28.756984 11248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 10:00:28.757570 11449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:43979 every 8 connection(s)
I20260808 10:00:28.760215 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 11248
I20260808 10:00:28.760330 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 10:00:28.760512 24863 external_mini_cluster.cc:1428] Setting key 96f468c345a065becb777ff6b92b7cd6
Aug 08 10:00:28 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183228, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:28.766997 11016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:28.758095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:58889 (local address 127.24.71.254:33039)
0808 10:00:28.758137 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:28.758140 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:28.758151 (+ 11us) server_negotiation.cc:407] Connection header received
0808 10:00:28.758633 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:28.758634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:28.758648 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:28.758693 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:28.759275 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:28.759858 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:28.761429 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:28.761645 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:28.761728 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:28.763996 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:28.763998 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:28.763998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:28.764012 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:28.765568 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:28.766001 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:28.766002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:28.766003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:28.766058 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:28.766327 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:28.766328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:28.766328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:28.766455 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:28.766532 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:28.766820 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 10:00:28.766904 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 10:00:28.767227 11452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:28.757773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33039 (local address 127.24.71.195:58889)
0808 10:00:28.757952 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:28.757996 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:28.758524 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:28.758759 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:28.758763 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:28.758967 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:28.759179 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:28.759183 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:28.759959 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:28.759961 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:28.761352 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:28.761355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:28.761746 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:28.761747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:28.761889 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:28.762454 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:28.762463 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:28.763856 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:28.765646 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:28.765654 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:28.765656 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:28.765901 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:28.766130 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:28.766131 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:28.766132 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:28.766258 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:28.766523 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:28.766529 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:28.766681 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 10:00:28.766788 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 10:00:28.766961 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":108,"threads_started":1}
I20260808 10:00:28.767803 11450 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33039
I20260808 10:00:28.767925 11450 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:28.768123 11450 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
I20260808 10:00:28.768548 10699 ts_manager.cc:194] Registered new tserver with Master: 53ad800ed24a4d53b5fe575cf87e6177 (127.24.71.195:43979)
I20260808 10:00:28.768929 10699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:58889
I20260808 10:00:28.772099 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 10:00:28.772780 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 10820
I20260808 10:00:28.833976 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 11021
I20260808 10:00:28.843421 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 11248
I20260808 10:00:28.859596 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 10653
I20260808 10:00:28.869392 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33039
--webserver_interface=127.24.71.254
--webserver_port=35665
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:33039
--ranger_config_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.71.212:35637/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.71.212:35637/kms with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:28.954003 11453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:28.954288 11453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:28.954329 11453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:28.955700 11453 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:00:28.955775 11453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:28.955798 11453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:28.955826 11453 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:00:28.955874 11453 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:00:28.957617 11453 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.71.212:35637/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:33039
--ranger_config_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=35665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:28.957932 11453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:28.958176 11453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:28.963999 11461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:28.964011 11465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:28.964135 11462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:28.964480 11453 server_base.cc:1034] running on GCE node
I20260808 10:00:28.964766 11453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:28.965117 11453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:28.966313 11453 hybrid_clock.cc:648] HybridClock initialized: now 1786183228966298 us; error 28 us; skew 500 ppm
Aug 08 10:00:28 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183228, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:28.969311 11453 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:00:28.969839 11453 webserver.cc:460] Webserver started at http://127.24.71.254:35665/ using document root <none> and password file <none>
I20260808 10:00:28.970082 11453 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:28.970157 11453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 10:00:28 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183228, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 10:00:29.013034 11453 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:00:29.013891 11473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:29.014125 11453 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:00:29.014230 11453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "c97140e55f9a4e95bcb7ebf2f50dd463"
format_stamp: "Formatted at 2026-08-08 10:00:27 on dist-test-slave-gw5c"
server_key: "a22f63cb122edd7a05304e387840a371"
server_key_iv: "0696809a609155190eb1635d08c5f992"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:29.014721 11453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:29.028388 11453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:29.030469 11453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:29.030624 11453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:29.035754 11453 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:33039
I20260808 10:00:29.035784 11559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:33039 every 8 connection(s)
I20260808 10:00:29.036239 11453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:00:29.037611 11560 sys_catalog.cc:263] Verifying existing consensus state
I20260808 10:00:29.038285 11560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463: Bootstrap starting.
I20260808 10:00:29.046288 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 11453
I20260808 10:00:29.046523 11560 log.cc:824] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:29.046634 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.71.212:35637/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:37033
--local_ip_for_outbound_sockets=127.24.71.193
--tserver_master_addrs=127.24.71.254:33039
--webserver_port=40373
--webserver_interface=127.24.71.193
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.71.212:35637/kms with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:00:29.048781 11560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 10:00:29.049122 11560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463: Bootstrap complete.
I20260808 10:00:29.051889 11560 raft_consensus.cc:348] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33039 } }
I20260808 10:00:29.052151 11560 raft_consensus.cc:729] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c97140e55f9a4e95bcb7ebf2f50dd463, State: Initialized, Role: FOLLOWER
I20260808 10:00:29.052354 11560 consensus_queue.cc:260] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33039 } }
I20260808 10:00:29.052453 11560 raft_consensus.cc:388] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:00:29.052522 11560 raft_consensus.cc:482] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:00:29.052598 11560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 1 FOLLOWER]: Advancing to term 2
I20260808 10:00:29.053640 11560 raft_consensus.cc:504] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33039 } }
I20260808 10:00:29.053764 11560 leader_election.cc:302] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c97140e55f9a4e95bcb7ebf2f50dd463; no voters:
I20260808 10:00:29.053998 11560 leader_election.cc:288] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 10:00:29.054036 11568 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 10:00:29.054245 11568 raft_consensus.cc:686] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [term 2 LEADER]: Becoming Leader. State: Replica: c97140e55f9a4e95bcb7ebf2f50dd463, State: Running, Role: LEADER
I20260808 10:00:29.054374 11560 sys_catalog.cc:564] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:00:29.054390 11568 consensus_queue.cc:237] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33039 } }
I20260808 10:00:29.054728 11568 sys_catalog.cc:455] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33039 } } }
I20260808 10:00:29.054900 11568 sys_catalog.cc:458] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:29.055066 11568 sys_catalog.cc:455] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c97140e55f9a4e95bcb7ebf2f50dd463. Latest consensus state: current_term: 2 leader_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c97140e55f9a4e95bcb7ebf2f50dd463" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33039 } } }
I20260808 10:00:29.055122 11568 sys_catalog.cc:458] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:29.055259 11573 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:00:29.055850 11573 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:00:29.056056 11573 catalog_manager.cc:1259] Loaded cluster ID: 9e8652dc627f4e90ad376bce80589306
I20260808 10:00:29.056154 11573 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:00:29.056551 11560 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 10:00:29.057476 11573 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:00:29.057662 11573 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463: Loaded TSK: 0
I20260808 10:00:29.057870 11573 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 10:00:29.166980 11567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:29.167479 11567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:29.167586 11567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:29.169440 11567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:29.169675 11567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:29.169777 11567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:00:29.172180 11567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.71.212:35637/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:37033
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=40373
--tserver_master_addrs=127.24.71.254:33039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:29.172946 11567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:29.173291 11567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:29.180116 11619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:29.180667 11613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:29.180958 11614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:29.181161 11567 server_base.cc:1034] running on GCE node
I20260808 10:00:29.181380 11567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:29.181654 11567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:29.182804 11567 hybrid_clock.cc:648] HybridClock initialized: now 1786183229182764 us; error 52 us; skew 500 ppm
Aug 08 10:00:29 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183229, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:29.186291 11567 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 10:00:29.186827 11567 webserver.cc:460] Webserver started at http://127.24.71.193:40373/ using document root <none> and password file <none>
I20260808 10:00:29.187117 11567 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:29.187187 11567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 10:00:29 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183229, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 10:00:29.220108 11567 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.000s sys 0.001s
I20260808 10:00:29.231950 11628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:29.232251 11567 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.000s sys 0.001s
I20260808 10:00:29.232358 11567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "0db919a3b31f4ecf887fc7aef8e04be4"
format_stamp: "Formatted at 2026-08-08 10:00:28 on dist-test-slave-gw5c"
server_key: "bc94e9506705fab0bfbfb39f0e90025e"
server_key_iv: "193c07510548579c13c9ab356efd65be"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:29.232965 11567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:29.245074 11567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:29.247610 11567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:29.247865 11567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:29.248211 11567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:29.248679 11567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:29.248739 11567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:29.248844 11567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:29.248906 11567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:29.255568 11567 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:37033
I20260808 10:00:29.255982 11567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 10:00:29.260739 11810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:37033 every 8 connection(s)
I20260808 10:00:29.265240 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 11567
I20260808 10:00:29.265570 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.71.212:35637/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:41191
--local_ip_for_outbound_sockets=127.24.71.194
--tserver_master_addrs=127.24.71.254:33039
--webserver_port=38117
--webserver_interface=127.24.71.194
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.71.212:35637/kms with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 10:00:29 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183229, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:29.276458 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:29.261569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33039 (local address 127.24.71.193:60823)
0808 10:00:29.263519 (+ 1950us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:29.263559 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:29.264066 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:29.264608 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:29.264613 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:29.264822 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:29.265072 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:29.265078 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.266682 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.266683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:29.267928 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:29.267931 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.268816 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.268818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:29.268978 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:29.269633 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:29.269644 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:29.271545 (+ 1901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:29.274122 (+ 2577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:29.274131 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:29.274134 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:29.274487 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:29.274858 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:29.274860 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:29.274860 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:29.275029 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:29.275645 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:29.275652 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:29.275828 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 10:00:29.275948 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 10:00:29.276139 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1905,"thread_start_us":91,"threads_started":1}
I20260808 10:00:29.277704 11818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:29.261627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:60823 (local address 127.24.71.254:33039)
0808 10:00:29.264239 (+ 2612us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:29.264246 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:29.264270 (+ 24us) server_negotiation.cc:407] Connection header received
0808 10:00:29.264382 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:29.264386 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:29.264429 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:29.264567 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:29.265222 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.266555 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.268021 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.268678 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.269291 (+ 613us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:29.271677 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:29.271681 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:29.271682 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:29.271694 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:29.274004 (+ 2310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:29.274598 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:29.274602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:29.274602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:29.274749 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:29.275141 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:29.275142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:29.275142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:29.275537 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:29.277202 (+ 1665us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:29.277299 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 10:00:29.277451 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2561,"thread_start_us":87,"threads_started":1}
I20260808 10:00:29.278733 11812 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33039
I20260808 10:00:29.278837 11812 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:29.279076 11812 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
W20260808 10:00:29.280153 11812 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:33039 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 10:00:29.280227 11812 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:29.280303 11812 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
I20260808 10:00:29.280745 11812 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:29.280826 11812 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
W20260808 10:00:29.281213 11812 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 10:00:29.378185 11819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:29.378566 11819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:29.378633 11819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:29.380412 11819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:29.380476 11819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:29.380517 11819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:00:29.382701 11819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.71.212:35637/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:41191
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=38117
--tserver_master_addrs=127.24.71.254:33039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:29.382957 11819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:29.383225 11819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:29.389744 11828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:29.390156 11831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:29.390496 11819 server_base.cc:1034] running on GCE node
W20260808 10:00:29.392081 11826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:29.392418 11819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:29.392695 11819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:29.393868 11819 hybrid_clock.cc:648] HybridClock initialized: now 1786183229393832 us; error 53 us; skew 500 ppm
Aug 08 10:00:29 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183229, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:29.396742 11819 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 10:00:29.397238 11819 webserver.cc:460] Webserver started at http://127.24.71.194:38117/ using document root <none> and password file <none>
I20260808 10:00:29.397539 11819 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:29.397624 11819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 10:00:29 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183229, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 10:00:29.416046 11819 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260808 10:00:29.417219 11842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:29.417452 11819 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 10:00:29.417542 11819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "5238dcebe25943e1b76bd6beea0f6c52"
format_stamp: "Formatted at 2026-08-08 10:00:28 on dist-test-slave-gw5c"
server_key: "82d191b3d63353425a8299b33b649d34"
server_key_iv: "4eb4064e128d5a0dd9f405a738c33b43"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:29.418009 11819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:29.441582 11819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:29.444432 11819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:29.444687 11819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:29.445065 11819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:29.445542 11819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:29.445649 11819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:29.445750 11819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:29.445824 11819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:29.453444 11819 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:41191
I20260808 10:00:29.454100 11819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 10:00:29.455773 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 11819
I20260808 10:00:29.455780 12031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:41191 every 8 connection(s)
I20260808 10:00:29.456120 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.71.212:35637/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:43979
--local_ip_for_outbound_sockets=127.24.71.195
--tserver_master_addrs=127.24.71.254:33039
--webserver_port=38971
--webserver_interface=127.24.71.195
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.71.212:35637/kms with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 10:00:29 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183229, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:29.469548 11818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:29.455636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:37673 (local address 127.24.71.254:33039)
0808 10:00:29.455685 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:29.455687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:29.458243 (+ 2556us) server_negotiation.cc:407] Connection header received
0808 10:00:29.459023 (+ 780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:29.459025 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:29.459043 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:29.459078 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:29.460069 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.460846 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.462478 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.462828 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.462927 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:29.465823 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:29.465825 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:29.465826 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:29.465835 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:29.467750 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:29.468293 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:29.468295 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:29.468295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:29.468369 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:29.468718 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:29.468719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:29.468720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:29.468876 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:29.468937 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:29.469338 (+ 401us) server_negotiation.cc:299] Negotiation successful
0808 10:00:29.469437 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 10:00:29.470407 12035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:29.455242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33039 (local address 127.24.71.194:37673)
0808 10:00:29.455485 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:29.455541 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:29.458849 (+ 3308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:29.459309 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:29.459314 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:29.459607 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:29.459907 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:29.459914 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.460977 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.460978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:29.462367 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:29.462370 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.462961 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.462963 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:29.463110 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:29.464110 (+ 1000us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:29.464121 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:29.465699 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:29.467852 (+ 2153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:29.467859 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:29.467862 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:29.468175 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:29.468453 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:29.468454 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:29.468455 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:29.468612 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:29.468977 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:29.468984 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:29.469155 (+ 171us) client_negotiation.cc:769] Sending connection context
0808 10:00:29.469953 (+ 798us) client_negotiation.cc:240] Negotiation successful
0808 10:00:29.470139 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":165,"threads_started":1}
I20260808 10:00:29.471164 12033 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33039
I20260808 10:00:29.471282 12033 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:29.471514 12033 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
W20260808 10:00:29.472254 12033 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:33039 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 10:00:29.472334 12033 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:29.472401 12033 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
I20260808 10:00:29.472782 12033 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:29.472862 12033 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
W20260808 10:00:29.473207 12033 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 10:00:29.569274 12038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:29.569656 12038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:29.569758 12038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:29.571635 12038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:29.571750 12038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:29.571851 12038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:00:29.574049 12038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.71.212:35637/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:43979
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=38971
--tserver_master_addrs=127.24.71.254:33039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:29.574673 12038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:29.575021 12038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:29.580210 12045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:29.580327 12048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:29.580219 12043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:29.581427 12038 server_base.cc:1034] running on GCE node
I20260808 10:00:29.581637 12038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:29.581909 12038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:29.583073 12038 hybrid_clock.cc:648] HybridClock initialized: now 1786183229583054 us; error 35 us; skew 500 ppm
Aug 08 10:00:29 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183229, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:29.586166 12038 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 10:00:29.586746 12038 webserver.cc:460] Webserver started at http://127.24.71.195:38971/ using document root <none> and password file <none>
I20260808 10:00:29.586952 12038 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:29.587002 12038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 10:00:29 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183229, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 10:00:29.609864 12038 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.001s sys 0.000s
I20260808 10:00:29.618573 12062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:29.618881 12038 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.000s sys 0.000s
I20260808 10:00:29.619024 12038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "53ad800ed24a4d53b5fe575cf87e6177"
format_stamp: "Formatted at 2026-08-08 10:00:28 on dist-test-slave-gw5c"
server_key: "bcde42e96f8a4f94e15d55dc930156fc"
server_key_iv: "a134ee0433ceb3f856eacbcc5687f8a9"
server_key_version: "kuduclusterkey@0"
I20260808 10:00:29.619655 12038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:29.638682 12038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:29.641147 12038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:29.641314 12038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:29.641637 12038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:29.642074 12038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:29.642128 12038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:29.642160 12038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:29.642179 12038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:29.649842 12038 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:43979
I20260808 10:00:29.649951 12242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:43979 every 8 connection(s)
I20260808 10:00:29.650450 12038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 10:00:29.656306 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 12038
Aug 08 10:00:29 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183229, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:29.662513 11818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:29.651664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:43113 (local address 127.24.71.254:33039)
0808 10:00:29.651714 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:29.651716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:29.651729 (+ 13us) server_negotiation.cc:407] Connection header received
0808 10:00:29.652404 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:29.652407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:29.652420 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:29.652486 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:29.653290 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.653947 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.655055 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.655314 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.655414 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:29.658036 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:29.658038 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:29.658039 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:29.658047 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:29.659695 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:29.660472 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:29.660474 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:29.660474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:29.660577 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:29.661169 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:29.661170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:29.661170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:29.661393 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:29.661447 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:29.662302 (+ 855us) server_negotiation.cc:299] Negotiation successful
0808 10:00:29.662401 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 10:00:29.663146 12247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:29.651304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33039 (local address 127.24.71.195:43113)
0808 10:00:29.651537 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:29.651592 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:29.652249 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:29.652580 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:29.652586 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:29.652826 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:29.653175 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:29.653183 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.654055 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.654057 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:29.654962 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:29.654965 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.655453 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.655455 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:29.655573 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:29.656308 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:29.656320 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:29.657936 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:29.659780 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:29.659789 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:29.659791 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:29.660322 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:29.660728 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:29.660729 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:29.660729 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:29.660983 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:29.661905 (+ 922us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:29.661913 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:29.662122 (+ 209us) client_negotiation.cc:769] Sending connection context
0808 10:00:29.662658 (+ 536us) client_negotiation.cc:240] Negotiation successful
0808 10:00:29.662848 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":147,"threads_started":1}
I20260808 10:00:29.663808 12245 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33039
I20260808 10:00:29.663933 12245 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:29.664155 12245 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
W20260808 10:00:29.665518 12245 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:33039 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 10:00:29.665603 12245 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:29.665676 12245 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
I20260808 10:00:29.666043 12245 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:29.666126 12245 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
W20260808 10:00:29.666441 12245 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 10:00:29.666987 12253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:29.656791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52418 (local address 127.24.71.254:33039)
0808 10:00:29.657170 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:29.657173 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:29.657181 (+ 8us) server_negotiation.cc:407] Connection header received
0808 10:00:29.657202 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:29.657203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:29.657215 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:29.657286 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:29.658117 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.658840 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.661078 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:29.661736 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:29.661810 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:29.664049 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:29.664051 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:29.664051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:29.664059 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:29.665821 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:29.666226 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:29.666227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:29.666228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:29.666289 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:29.666473 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:29.666474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:29.666474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:29.666622 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:29.666747 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:29.666847 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 10:00:29.666917 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":83,"threads_started":1}
I20260808 10:00:30.281401 11812 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:30.281579 11812 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
I20260808 10:00:30.281983 11500 ts_manager.cc:194] Registered new tserver with Master: 0db919a3b31f4ecf887fc7aef8e04be4 (127.24.71.193:37033)
I20260808 10:00:30.282797 11500 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:60823
Aug 08 10:00:30 dist-test-slave-gw5c krb5kdc[9917](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786183230, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:30.473428 12033 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:30.473608 12033 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
I20260808 10:00:30.473999 11500 ts_manager.cc:194] Registered new tserver with Master: 5238dcebe25943e1b76bd6beea0f6c52 (127.24.71.194:41191)
I20260808 10:00:30.474555 11500 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:37673
I20260808 10:00:30.666620 12245 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:30.666790 12245 heartbeater.cc:511] Master 127.24.71.254:33039 requested a full tablet report, sending...
I20260808 10:00:30.667210 11500 ts_manager.cc:194] Registered new tserver with Master: 53ad800ed24a4d53b5fe575cf87e6177 (127.24.71.195:43979)
I20260808 10:00:30.667865 11500 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:43113
I20260808 10:00:30.676409 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 10:00:30.691670 12282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.678305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52434 (local address 127.24.71.254:33039)
0808 10:00:30.683451 (+ 5146us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:30.683453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:30.683635 (+ 182us) server_negotiation.cc:407] Connection header received
0808 10:00:30.683744 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:30.683744 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:30.683757 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:30.683803 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:30.684788 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.685600 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.686651 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.686979 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.687019 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:30.688527 (+ 1508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:30.688529 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:30.688529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:30.688537 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:30.690358 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:30.690760 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:30.690761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:30.690761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:30.690817 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:30.691022 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:30.691022 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:30.691023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:30.691149 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:30.691222 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:30.691471 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 10:00:30.691561 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5114,"thread_start_us":70,"threads_started":1}
I20260808 10:00:30.694332 11500 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52434:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 10:00:30.696550 11500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 08 10:00:30 dist-test-slave-gw5c krb5kdc[9917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183230, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for HTTP/127.24.71.212@KRBTEST.COM
I20260808 10:00:30.723925 12296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.715231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:41191 (local address 127.0.0.1:51178)
0808 10:00:30.718476 (+ 3245us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:30.718527 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:30.718611 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:30.718950 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:30.718953 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:30.718956 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:30.719051 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:30.719053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.720874 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.720875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:30.722092 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:30.722095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.723573 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.723574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:30.723670 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:30.723685 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 10:00:30.723755 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 10:00:30.723811 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3209,"thread_start_us":84,"threads_started":1}
I20260808 10:00:30.724521 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.715529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51178 (local address 127.24.71.194:41191)
0808 10:00:30.715658 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:30.715664 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:30.718605 (+ 2941us) server_negotiation.cc:407] Connection header received
0808 10:00:30.718717 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:30.718720 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:30.718740 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:30.718825 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:30.719185 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.720774 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.722186 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.723370 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.723474 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:30.723535 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:30.724389 (+ 854us) server_negotiation.cc:299] Negotiation successful
0808 10:00:30.724442 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":67,"threads_started":1}
I20260808 10:00:30.724910 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.715231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:37033 (local address 127.0.0.1:34292)
0808 10:00:30.718801 (+ 3570us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:30.718811 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:30.718857 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:30.719181 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:30.719182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:30.719184 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:30.719230 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:30.719231 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.720396 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.720397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:30.721714 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:30.721717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.724675 (+ 2958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.724676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:30.724742 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:30.724746 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:00:30.724796 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 10:00:30.724837 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3535,"mutex_wait_us":3,"thread_start_us":95,"threads_started":1}
I20260808 10:00:30.725456 11920 tablet_service.cc:1467] Processing CreateTablet for tablet 9309ee412c8346e499f381aa30f460dc (DEFAULT_TABLE table=test-table [id=6ab09bc0f93c4ce59d67df98ebaa543e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:00:30.725860 11920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9309ee412c8346e499f381aa30f460dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:30.726439 12306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.715529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34292 (local address 127.24.71.193:37033)
0808 10:00:30.715668 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:30.715673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:30.718919 (+ 3246us) server_negotiation.cc:407] Connection header received
0808 10:00:30.718991 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:30.718993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:30.719010 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:30.719074 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:30.719310 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.720289 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.721823 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.722772 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.722866 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:30.722930 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:30.726307 (+ 3377us) server_negotiation.cc:299] Negotiation successful
0808 10:00:30.726360 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":49,"threads_started":1}
I20260808 10:00:30.727687 12294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.715290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:43979 (local address 127.0.0.1:44664)
0808 10:00:30.723059 (+ 7769us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:30.723072 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:30.723173 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:30.723468 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:30.723469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:30.723471 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:30.723526 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:30.723528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.725072 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.725073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:30.726194 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:30.726197 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.727448 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.727449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:30.727517 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:30.727520 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 10:00:30.727563 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 10:00:30.727599 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7746,"thread_start_us":135,"threads_started":1}
I20260808 10:00:30.727959 12298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.715411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44664 (local address 127.24.71.195:43979)
0808 10:00:30.718382 (+ 2971us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:30.718388 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:30.723140 (+ 4752us) server_negotiation.cc:407] Connection header received
0808 10:00:30.723257 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:30.723260 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:30.723277 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:30.723330 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:30.723596 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.724538 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.726579 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.727267 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.727316 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:30.727364 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:30.727815 (+ 451us) server_negotiation.cc:299] Negotiation successful
0808 10:00:30.727867 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2926,"thread_start_us":57,"threads_started":1}
I20260808 10:00:30.730105 12308 tablet_bootstrap.cc:492] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52: Bootstrap starting.
I20260808 10:00:30.731091 12308 tablet_bootstrap.cc:654] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:30.731088 12132 tablet_service.cc:1467] Processing CreateTablet for tablet 9309ee412c8346e499f381aa30f460dc (DEFAULT_TABLE table=test-table [id=6ab09bc0f93c4ce59d67df98ebaa543e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:00:30.731977 12308 log.cc:824] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:30.732254 11711 tablet_service.cc:1467] Processing CreateTablet for tablet 9309ee412c8346e499f381aa30f460dc (DEFAULT_TABLE table=test-table [id=6ab09bc0f93c4ce59d67df98ebaa543e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:00:30.732576 11711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9309ee412c8346e499f381aa30f460dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:30.736670 12132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9309ee412c8346e499f381aa30f460dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:30.747605 12312 tablet_bootstrap.cc:492] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4: Bootstrap starting.
I20260808 10:00:30.747897 12311 tablet_bootstrap.cc:492] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177: Bootstrap starting.
I20260808 10:00:30.748214 12308 tablet_bootstrap.cc:492] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52: No bootstrap required, opened a new log
I20260808 10:00:30.748428 12308 ts_tablet_manager.cc:1397] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.003s
I20260808 10:00:30.749433 12312 tablet_bootstrap.cc:654] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:30.750305 12311 tablet_bootstrap.cc:654] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:30.750821 12311 log.cc:824] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:30.751673 12308 raft_consensus.cc:348] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db919a3b31f4ecf887fc7aef8e04be4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 37033 } } peers { permanent_uuid: "53ad800ed24a4d53b5fe575cf87e6177" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43979 } } peers { permanent_uuid: "5238dcebe25943e1b76bd6beea0f6c52" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41191 } }
I20260808 10:00:30.751888 12312 log.cc:824] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:30.751963 12311 tablet_bootstrap.cc:492] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177: No bootstrap required, opened a new log
I20260808 10:00:30.752013 12308 raft_consensus.cc:374] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:30.752096 12308 raft_consensus.cc:729] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5238dcebe25943e1b76bd6beea0f6c52, State: Initialized, Role: FOLLOWER
I20260808 10:00:30.752195 12311 ts_tablet_manager.cc:1397] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 10:00:30.752265 12308 consensus_queue.cc:260] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db919a3b31f4ecf887fc7aef8e04be4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 37033 } } peers { permanent_uuid: "53ad800ed24a4d53b5fe575cf87e6177" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43979 } } peers { permanent_uuid: "5238dcebe25943e1b76bd6beea0f6c52" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41191 } }
I20260808 10:00:30.752633 12308 ts_tablet_manager.cc:1428] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260808 10:00:30.753051 12033 heartbeater.cc:503] Master 127.24.71.254:33039 was elected leader, sending a full tablet report...
I20260808 10:00:30.754652 12312 tablet_bootstrap.cc:492] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4: No bootstrap required, opened a new log
I20260808 10:00:30.754771 12312 ts_tablet_manager.cc:1397] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260808 10:00:30.758423 12312 raft_consensus.cc:348] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db919a3b31f4ecf887fc7aef8e04be4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 37033 } } peers { permanent_uuid: "53ad800ed24a4d53b5fe575cf87e6177" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43979 } } peers { permanent_uuid: "5238dcebe25943e1b76bd6beea0f6c52" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41191 } }
I20260808 10:00:30.758673 12312 raft_consensus.cc:374] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:30.758752 12312 raft_consensus.cc:729] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db919a3b31f4ecf887fc7aef8e04be4, State: Initialized, Role: FOLLOWER
I20260808 10:00:30.758960 12312 consensus_queue.cc:260] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db919a3b31f4ecf887fc7aef8e04be4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 37033 } } peers { permanent_uuid: "53ad800ed24a4d53b5fe575cf87e6177" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43979 } } peers { permanent_uuid: "5238dcebe25943e1b76bd6beea0f6c52" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41191 } }
I20260808 10:00:30.759372 12312 ts_tablet_manager.cc:1428] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
I20260808 10:00:30.759560 11812 heartbeater.cc:503] Master 127.24.71.254:33039 was elected leader, sending a full tablet report...
I20260808 10:00:30.770783 12311 raft_consensus.cc:348] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db919a3b31f4ecf887fc7aef8e04be4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 37033 } } peers { permanent_uuid: "53ad800ed24a4d53b5fe575cf87e6177" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43979 } } peers { permanent_uuid: "5238dcebe25943e1b76bd6beea0f6c52" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41191 } }
I20260808 10:00:30.771198 12311 raft_consensus.cc:374] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:30.772140 12311 raft_consensus.cc:729] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53ad800ed24a4d53b5fe575cf87e6177, State: Initialized, Role: FOLLOWER
I20260808 10:00:30.772348 12311 consensus_queue.cc:260] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db919a3b31f4ecf887fc7aef8e04be4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 37033 } } peers { permanent_uuid: "53ad800ed24a4d53b5fe575cf87e6177" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43979 } } peers { permanent_uuid: "5238dcebe25943e1b76bd6beea0f6c52" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41191 } }
I20260808 10:00:30.772775 12311 ts_tablet_manager.cc:1428] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260808 10:00:30.772938 12245 heartbeater.cc:503] Master 127.24.71.254:33039 was elected leader, sending a full tablet report...
I20260808 10:00:30.850968 12319 raft_consensus.cc:482] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:00:30.851166 12319 raft_consensus.cc:504] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db919a3b31f4ecf887fc7aef8e04be4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 37033 } } peers { permanent_uuid: "53ad800ed24a4d53b5fe575cf87e6177" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43979 } } peers { permanent_uuid: "5238dcebe25943e1b76bd6beea0f6c52" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41191 } }
I20260808 10:00:30.851704 12319 leader_election.cc:288] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0db919a3b31f4ecf887fc7aef8e04be4 (127.24.71.193:37033), 5238dcebe25943e1b76bd6beea0f6c52 (127.24.71.194:41191)
I20260808 10:00:30.857014 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.852148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:53273 (local address 127.24.71.194:41191)
0808 10:00:30.852247 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:30.852250 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:30.852541 (+ 291us) server_negotiation.cc:407] Connection header received
0808 10:00:30.852642 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:30.852643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:30.852653 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:30.852684 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:30.853120 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.853818 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.855769 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.856405 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.856446 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:30.856454 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:30.856890 (+ 436us) server_negotiation.cc:299] Negotiation successful
0808 10:00:30.856938 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 10:00:30.857014 12306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.852018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:37987 (local address 127.24.71.193:37033)
0808 10:00:30.852076 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:30.852079 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:30.852428 (+ 349us) server_negotiation.cc:407] Connection header received
0808 10:00:30.852574 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:30.852575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:30.852585 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:30.852619 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:30.853029 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.853775 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.855721 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.856388 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.856445 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:30.856454 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:30.856899 (+ 445us) server_negotiation.cc:299] Negotiation successful
0808 10:00:30.856943 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 10:00:30.857546 12320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.851881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:37033 (local address 127.24.71.195:37987)
0808 10:00:30.852306 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:30.852317 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:30.852476 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:30.852695 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:30.852695 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:30.852697 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:30.852874 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:30.852877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.853895 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.853896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:30.855610 (+ 1714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:30.855614 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.856647 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.856648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:30.856786 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:30.856793 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 10:00:30.857309 (+ 516us) client_negotiation.cc:240] Negotiation successful
0808 10:00:30.857344 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":3,"thread_start_us":237,"threads_started":1}
I20260808 10:00:30.857545 12321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.851904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:41191 (local address 127.24.71.195:53273)
0808 10:00:30.852481 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:30.852491 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:30.852563 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:30.852746 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:30.852747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:30.852748 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:30.853033 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:30.853035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.853904 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.853905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:30.855675 (+ 1770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:30.855677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.856676 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.856678 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:30.856787 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:30.856790 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 10:00:30.857240 (+ 450us) client_negotiation.cc:240] Negotiation successful
0808 10:00:30.857289 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"mutex_wait_us":4,"thread_start_us":439,"threads_started":1}
I20260808 10:00:30.858143 11723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9309ee412c8346e499f381aa30f460dc" candidate_uuid: "53ad800ed24a4d53b5fe575cf87e6177" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db919a3b31f4ecf887fc7aef8e04be4" is_pre_election: true
I20260808 10:00:30.858348 11723 raft_consensus.cc:2454] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53ad800ed24a4d53b5fe575cf87e6177 in term 0.
I20260808 10:00:30.858469 11950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9309ee412c8346e499f381aa30f460dc" candidate_uuid: "53ad800ed24a4d53b5fe575cf87e6177" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5238dcebe25943e1b76bd6beea0f6c52" is_pre_election: true
I20260808 10:00:30.858736 11950 raft_consensus.cc:2454] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53ad800ed24a4d53b5fe575cf87e6177 in term 0.
I20260808 10:00:30.858716 12067 leader_election.cc:302] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db919a3b31f4ecf887fc7aef8e04be4, 53ad800ed24a4d53b5fe575cf87e6177; no voters:
I20260808 10:00:30.858868 12319 raft_consensus.cc:2781] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 10:00:30.858919 12319 raft_consensus.cc:482] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 10:00:30.858939 12319 raft_consensus.cc:3037] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:30.860127 12319 raft_consensus.cc:504] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db919a3b31f4ecf887fc7aef8e04be4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 37033 } } peers { permanent_uuid: "53ad800ed24a4d53b5fe575cf87e6177" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43979 } } peers { permanent_uuid: "5238dcebe25943e1b76bd6beea0f6c52" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41191 } }
I20260808 10:00:30.860288 12319 leader_election.cc:288] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [CANDIDATE]: Term 1 election: Requested vote from peers 0db919a3b31f4ecf887fc7aef8e04be4 (127.24.71.193:37033), 5238dcebe25943e1b76bd6beea0f6c52 (127.24.71.194:41191)
I20260808 10:00:30.860492 11723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9309ee412c8346e499f381aa30f460dc" candidate_uuid: "53ad800ed24a4d53b5fe575cf87e6177" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db919a3b31f4ecf887fc7aef8e04be4"
I20260808 10:00:30.860544 11950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9309ee412c8346e499f381aa30f460dc" candidate_uuid: "53ad800ed24a4d53b5fe575cf87e6177" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5238dcebe25943e1b76bd6beea0f6c52"
I20260808 10:00:30.860592 11723 raft_consensus.cc:3037] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:30.860662 11950 raft_consensus.cc:3037] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:30.861505 11723 raft_consensus.cc:2454] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53ad800ed24a4d53b5fe575cf87e6177 in term 1.
I20260808 10:00:30.861671 12067 leader_election.cc:302] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db919a3b31f4ecf887fc7aef8e04be4, 53ad800ed24a4d53b5fe575cf87e6177; no voters:
I20260808 10:00:30.861757 12319 raft_consensus.cc:2781] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:00:30.861950 12319 raft_consensus.cc:686] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [term 1 LEADER]: Becoming Leader. State: Replica: 53ad800ed24a4d53b5fe575cf87e6177, State: Running, Role: LEADER
I20260808 10:00:30.862056 12319 consensus_queue.cc:237] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db919a3b31f4ecf887fc7aef8e04be4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 37033 } } peers { permanent_uuid: "53ad800ed24a4d53b5fe575cf87e6177" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43979 } } peers { permanent_uuid: "5238dcebe25943e1b76bd6beea0f6c52" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41191 } }
I20260808 10:00:30.862079 11950 raft_consensus.cc:2454] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53ad800ed24a4d53b5fe575cf87e6177 in term 1.
I20260808 10:00:30.862901 11500 catalog_manager.cc:5495] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53ad800ed24a4d53b5fe575cf87e6177 (127.24.71.195). New cstate: current_term: 1 leader_uuid: "53ad800ed24a4d53b5fe575cf87e6177" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0db919a3b31f4ecf887fc7aef8e04be4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 37033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53ad800ed24a4d53b5fe575cf87e6177" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 43979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5238dcebe25943e1b76bd6beea0f6c52" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41191 } health_report { overall_health: UNKNOWN } } }
I20260808 10:00:30.873759 12298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.871216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44676 (local address 127.24.71.195:43979)
0808 10:00:30.871266 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:30.871269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:30.871278 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:00:30.871354 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:30.871355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:30.871376 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:30.871459 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:00:30.871616 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.872109 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.872925 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:30.873143 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:30.873220 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:30.873399 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:00:30.873513 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:00:30.873600 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:30.873641 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 10:00:30.873664 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 10:00:30.876015 11723 raft_consensus.cc:1261] T 9309ee412c8346e499f381aa30f460dc P 0db919a3b31f4ecf887fc7aef8e04be4 [term 1 FOLLOWER]: Refusing update from remote peer 53ad800ed24a4d53b5fe575cf87e6177: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:00:30.876020 11950 raft_consensus.cc:1261] T 9309ee412c8346e499f381aa30f460dc P 5238dcebe25943e1b76bd6beea0f6c52 [term 1 FOLLOWER]: Refusing update from remote peer 53ad800ed24a4d53b5fe575cf87e6177: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:00:30.876413 12319 consensus_queue.cc:1035] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db919a3b31f4ecf887fc7aef8e04be4" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 37033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:00:30.876668 12322 consensus_queue.cc:1035] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5238dcebe25943e1b76bd6beea0f6c52" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:00:30.880681 12327 mvcc.cc:205] Tried to move back new op lower bound from 7316206513665069056 to 7316206513611436032. Current Snapshot: MvccSnapshot[applied={T|T < 7316206513665069056}]
I20260808 10:00:30.882491 12331 mvcc.cc:205] Tried to move back new op lower bound from 7316206513665069056 to 7316206513611436032. Current Snapshot: MvccSnapshot[applied={T|T < 7316206513665069056}]
I20260808 10:00:30.886317 11500 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:00:30.886425 11500 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:00:30.887188 11500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c97140e55f9a4e95bcb7ebf2f50dd463: Sending DeleteTablet for 3 replicas of tablet 9309ee412c8346e499f381aa30f460dc
I20260808 10:00:30.887557 12132 tablet_service.cc:1514] Processing DeleteTablet for tablet 9309ee412c8346e499f381aa30f460dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:30 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:44664
I20260808 10:00:30.887619 11920 tablet_service.cc:1514] Processing DeleteTablet for tablet 9309ee412c8346e499f381aa30f460dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:30 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:51178
I20260808 10:00:30.887789 11711 tablet_service.cc:1514] Processing DeleteTablet for tablet 9309ee412c8346e499f381aa30f460dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:30 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:34292
I20260808 10:00:30.888499 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 11567
I20260808 10:00:30.902081 12341 tablet_replica.cc:330] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177: stopping tablet replica
I20260808 10:00:30.902314 12341 raft_consensus.cc:2229] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [term 1 LEADER]: Raft consensus shutting down.
I20260808 10:00:30.902570 12341 raft_consensus.cc:2258] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 10:00:30.904663 11480 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:37033 (error 108)
I20260808 10:00:30.905658 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 11819
I20260808 10:00:30.905663 12294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.905505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:37033 (local address 127.0.0.1:34304)
0808 10:00:30.905565 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:30.905624 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 10:00:30.913246 11480 catalog_manager.cc:4584] TS 0db919a3b31f4ecf887fc7aef8e04be4 (127.24.71.193:37033): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9309ee412c8346e499f381aa30f460dc: Network error: Client connection negotiation failed: client connection to 127.24.71.193:37033: connect: Connection refused (error 111)
I20260808 10:00:30.913543 12341 ts_tablet_manager.cc:1905] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:00:30.916108 12341 ts_tablet_manager.cc:1918] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:00:30.916309 12341 log.cc:1196] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/9309ee412c8346e499f381aa30f460dc
I20260808 10:00:30.916700 12341 ts_tablet_manager.cc:1939] T 9309ee412c8346e499f381aa30f460dc P 53ad800ed24a4d53b5fe575cf87e6177: Deleting consensus metadata
I20260808 10:00:30.917300 11476 catalog_manager.cc:4841] TS 53ad800ed24a4d53b5fe575cf87e6177 (127.24.71.195:43979): tablet 9309ee412c8346e499f381aa30f460dc (table test-table [id=6ab09bc0f93c4ce59d67df98ebaa543e]) successfully deleted
I20260808 10:00:30.960165 12294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.959994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:41191 (local address 127.0.0.1:51190)
0808 10:00:30.960071 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:30.960113 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.194:41191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 10:00:30.960178 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 12038
I20260808 10:00:30.965932 12294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.965689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:37033 (local address 127.0.0.1:34308)
0808 10:00:30.965850 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:30.965882 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
I20260808 10:00:30.967306 12294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:30.967214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:37033 (local address 127.0.0.1:34312)
0808 10:00:30.967252 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:30.967274 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 10:00:30.972725 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 11453
I20260808 10:00:30.986131 24863 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 10:00:31.333693 24863 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 10:00:31.333797 24863 mini_ranger.cc:66] Stopping Ranger...
I20260808 10:00:31.689013 24863 mini_ranger.cc:68] Stopped Ranger
2026-08-08 10:00:31.689 UTC [9969] LOG: received smart shutdown request
2026-08-08 10:00:31.693 UTC [9969] LOG: background worker "logical replication launcher" (PID 9981) exited with exit code 1
2026-08-08 10:00:31.694 UTC [9975] LOG: shutting down
2026-08-08 10:00:31.878 UTC [9969] LOG: database system is shut down
2026-08-08T10:00:31Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51075 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:00:32 dist-test-slave-gw5c krb5kdc[12361](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:00:32 dist-test-slave-gw5c krb5kdc[12361](info): set up 2 sockets
Aug 08 10:00:32 dist-test-slave-gw5c krb5kdc[12361](info): commencing operation
krb5kdc: starting...
W20260808 10:00:33.267803 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:00:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:00:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:00:33.400393 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:46183
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:44963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:46183,127.24.71.253:45921,127.24.71.252:38189
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:33.483877 12378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:33.484086 12378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:33.484107 12378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:33.485309 12378 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:00:33.485355 12378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:33.485369 12378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:33.485383 12378 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:00:33.485432 12378 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:00:33.486948 12378 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:44963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:46183,127.24.71.253:45921,127.24.71.252:38189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:46183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:33.487210 12378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:33.487474 12378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:33.492575 12387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:33.492648 12378 server_base.cc:1034] running on GCE node
W20260808 10:00:33.492552 12388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:33.492609 12392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:33.493032 12378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:33.493340 12378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:33.494494 12378 hybrid_clock.cc:648] HybridClock initialized: now 1786183233494482 us; error 29 us; skew 500 ppm
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:33.497432 12378 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:00:33.497879 12378 webserver.cc:460] Webserver started at http://127.24.71.254:40325/ using document root <none> and password file <none>
I20260808 10:00:33.498129 12378 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:33.498175 12378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:33.498374 12378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:00:33.499541 12378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "c0e6ca89dc3b405aa75698f7ce1787df"
format_stamp: "Formatted at 2026-08-08 10:00:33 on dist-test-slave-gw5c"
server_key: "bd2c0da0b7d26bcfacc0783793dff267"
server_key_iv: "412360abfcb3c9ac82800c4ec9b5bc4c"
server_key_version: "encryptionkey@0"
I20260808 10:00:33.499915 12378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "c0e6ca89dc3b405aa75698f7ce1787df"
format_stamp: "Formatted at 2026-08-08 10:00:33 on dist-test-slave-gw5c"
server_key: "bd2c0da0b7d26bcfacc0783793dff267"
server_key_iv: "412360abfcb3c9ac82800c4ec9b5bc4c"
server_key_version: "encryptionkey@0"
I20260808 10:00:33.501385 12378 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:00:33.502365 12403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:33.502615 12378 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:00:33.502756 12378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "c0e6ca89dc3b405aa75698f7ce1787df"
format_stamp: "Formatted at 2026-08-08 10:00:33 on dist-test-slave-gw5c"
server_key: "bd2c0da0b7d26bcfacc0783793dff267"
server_key_iv: "412360abfcb3c9ac82800c4ec9b5bc4c"
server_key_version: "encryptionkey@0"
I20260808 10:00:33.502840 12378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:33.511831 12378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:33.513648 12378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:33.513823 12378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:33.518181 12378 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:46183
I20260808 10:00:33.518213 12487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:46183 every 8 connection(s)
I20260808 10:00:33.518584 12378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:00:33.519570 12488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:33.521545 12488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:00:33.525988 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 12378
I20260808 10:00:33.526100 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:00:33.526317 24863 external_mini_cluster.cc:1428] Setting key 9706278a9df841e586ea521db9f5d84d
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:33.532028 12493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.522403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37366 (local address 127.24.71.254:46183)
0808 10:00:33.522590 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.522600 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.522726 (+ 126us) server_negotiation.cc:407] Connection header received
0808 10:00:33.523279 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.523281 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.523303 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.523440 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.523984 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.524825 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.525751 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.526256 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.526377 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.528661 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.528669 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.528669 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.528677 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.530303 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.530777 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.530780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.530780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.530861 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.531095 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.531096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.531097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.531318 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.531433 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.531631 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.531776 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":82,"threads_started":1}
I20260808 10:00:33.532032 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.522381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:46183 (local address 127.0.0.1:37366)
0808 10:00:33.522580 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.522624 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:33.523117 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:33.523450 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:33.523453 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:33.523728 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:33.523878 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.523882 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.524948 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.524949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.525660 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.525662 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.526379 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.526380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.526470 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.527038 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:33.527046 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:33.528563 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:33.530406 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.530413 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.530416 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.530675 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.530938 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.530939 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.530939 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.531030 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.531413 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:33.531419 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:33.531483 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 10:00:33.531592 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 10:00:33.531839 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":97,"thread_start_us":90,"threads_started":1}
I20260808 10:00:33.532759 12488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:00:33.533125 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.533001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:45921 (local address 127.0.0.1:48152)
0808 10:00:33.533051 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.533099 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 10:00:33.533267 12405 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.71.253:45921: connect: Connection refused (error 111)
I20260808 10:00:33.533726 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.533632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:45921 (local address 127.0.0.1:48158)
0808 10:00:33.533680 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.533704 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 10:00:33.533838 12488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.253:45921: Network error: Client connection negotiation failed: client connection to 127.24.71.253:45921: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.24.71.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.253.keytab.
Entry for principal kudu/127.24.71.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.253.keytab.
I20260808 10:00:33.554059 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.253:45921
--webserver_interface=127.24.71.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.253.keytab
--principal=kudu/127.24.71.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:44963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:46183,127.24.71.253:45921,127.24.71.252:38189
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:00:33.583070 12488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } attempt: 1
I20260808 10:00:33.583701 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.583559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:45921 (local address 127.0.0.1:48174)
0808 10:00:33.583624 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.583670 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 10:00:33.584120 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.584032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:45921 (local address 127.0.0.1:48186)
0808 10:00:33.584076 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.584102 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 10:00:33.584228 12488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.253:45921: Network error: Client connection negotiation failed: client connection to 127.24.71.253:45921: connect: Connection refused (error 111)
W20260808 10:00:33.639823 12500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:33.640040 12500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:33.640062 12500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:33.641201 12500 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:00:33.641244 12500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:33.641259 12500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:33.641271 12500 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:00:33.641283 12500 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:00:33.642794 12500 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:44963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:46183,127.24.71.253:45921,127.24.71.252:38189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.253.keytab
--principal=kudu/127.24.71.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.253:45921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.71.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:33.643065 12500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:33.643299 12500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:33.648254 12512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:33.648267 12507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:33.648234 12508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:33.648521 12500 server_base.cc:1034] running on GCE node
I20260808 10:00:33.648768 12500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:33.649021 12500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:33.650192 12500 hybrid_clock.cc:648] HybridClock initialized: now 1786183233650185 us; error 38 us; skew 500 ppm
I20260808 10:00:33.652369 12488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } attempt: 2
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:33.652779 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.652644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:45921 (local address 127.0.0.1:48190)
0808 10:00:33.652709 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.652743 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 10:00:33.652943 12500 init.cc:377] Logged in from keytab as kudu/127.24.71.253@KRBTEST.COM (short username kudu)
I20260808 10:00:33.653206 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.653098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:45921 (local address 127.0.0.1:48202)
0808 10:00:33.653150 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.653181 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 10:00:33.653313 12488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.253:45921: Network error: Client connection negotiation failed: client connection to 127.24.71.253:45921: connect: Connection refused (error 111)
I20260808 10:00:33.653518 12500 webserver.cc:460] Webserver started at http://127.24.71.253:34139/ using document root <none> and password file <none>
I20260808 10:00:33.653756 12500 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:33.653820 12500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:33.653952 12500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:00:33.655019 12500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/data/instance:
uuid: "0afb9c1843354e46b1801adb4806f7ac"
format_stamp: "Formatted at 2026-08-08 10:00:33 on dist-test-slave-gw5c"
server_key: "a3fb17611b26deb766ca859a3d68bdde"
server_key_iv: "b8da6f13a7af66ea02832c89cc385c0f"
server_key_version: "encryptionkey@0"
I20260808 10:00:33.655443 12500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/wal/instance:
uuid: "0afb9c1843354e46b1801adb4806f7ac"
format_stamp: "Formatted at 2026-08-08 10:00:33 on dist-test-slave-gw5c"
server_key: "a3fb17611b26deb766ca859a3d68bdde"
server_key_iv: "b8da6f13a7af66ea02832c89cc385c0f"
server_key_version: "encryptionkey@0"
I20260808 10:00:33.656814 12500 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:00:33.657588 12523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:33.657761 12500 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 10:00:33.657871 12500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/wal
uuid: "0afb9c1843354e46b1801adb4806f7ac"
format_stamp: "Formatted at 2026-08-08 10:00:33 on dist-test-slave-gw5c"
server_key: "a3fb17611b26deb766ca859a3d68bdde"
server_key_iv: "b8da6f13a7af66ea02832c89cc385c0f"
server_key_version: "encryptionkey@0"
I20260808 10:00:33.657929 12500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:33.683091 12500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:33.685304 12500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:33.685433 12500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:33.689805 12500 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.253:45921
I20260808 10:00:33.689841 12599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.253:45921 every 8 connection(s)
I20260808 10:00:33.690243 12500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/data/info.pb
I20260808 10:00:33.691200 12601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:33.692838 12601 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.253@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:33.700253 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 12500
I20260808 10:00:33.700389 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-1/wal/instance
I20260808 10:00:33.700630 24863 external_mini_cluster.cc:1428] Setting key 89d13d4b310cf49d4ce0afb0174297f4
I20260808 10:00:33.702288 12603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.693562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:46183 (local address 127.0.0.1:37374)
0808 10:00:33.693730 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.693773 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:33.694238 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:33.694512 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:33.694516 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:33.694765 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:33.694975 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.694978 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.695728 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.695729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.696514 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.696516 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.696935 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.696936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.697039 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.697571 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:33.697580 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:33.699052 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:33.700926 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.700933 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.700935 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.701152 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.701391 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.701392 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.701392 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.701495 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.701797 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:33.701802 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:33.701924 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 10:00:33.702006 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 10:00:33.702125 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":94,"threads_started":1}
I20260808 10:00:33.702317 12493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.693611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37374 (local address 127.24.71.254:46183)
0808 10:00:33.693681 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.693683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.693864 (+ 181us) server_negotiation.cc:407] Connection header received
0808 10:00:33.694357 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.694359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.694371 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.694436 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.695052 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.695649 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.696616 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.696843 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.696916 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.699148 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.699150 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.699150 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.699158 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.700839 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.701240 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.701241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.701242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.701315 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.701562 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.701563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.701563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.701727 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.701806 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.702055 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.702159 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 10:00:33.703318 12601 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.253@KRBTEST.COM for kudu/127.24.71.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.71.252@KRBTEST.COM; defaulting to no policy
I20260808 10:00:33.711786 12603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.703646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:45921 (local address 127.0.0.1:48214)
0808 10:00:33.703716 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.703745 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:33.703806 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:33.704074 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:33.704075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:33.704229 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:33.704313 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.704315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.705477 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.705478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.706043 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.706045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.706628 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.706629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.706705 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.707155 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:33.707160 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:33.708577 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:33.710707 (+ 2130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.710708 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.710709 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.710887 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.711083 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.711084 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.711084 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.711137 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.711475 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:33.711476 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:33.711530 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 10:00:33.711622 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 10:00:33.711710 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 10:00:33.711921 12605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.703755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48214 (local address 127.24.71.253:45921)
0808 10:00:33.703931 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.703935 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.703951 (+ 16us) server_negotiation.cc:407] Connection header received
0808 10:00:33.703973 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.703975 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.703986 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.704059 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.704424 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.705345 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.706145 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.706532 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.706629 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.708670 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.708681 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.708681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.708689 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.710623 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.710964 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.710967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.710967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.711023 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.711191 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.711191 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.711192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.711378 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.711491 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.711656 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.711774 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":146,"thread_start_us":110,"threads_started":1}
I20260808 10:00:33.712591 12601 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:00:33.712965 12603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.712826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38468)
0808 10:00:33.712893 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.712943 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.252@KRBTEST.COM" created.
W20260808 10:00:33.713156 12525 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
I20260808 10:00:33.713635 12603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.713500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38476)
0808 10:00:33.713564 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.713598 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 10:00:33.713792 12601 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:38189: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.252.keytab.
Entry for principal kudu/127.24.71.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.252.keytab.
I20260808 10:00:33.730659 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.252:38189
--webserver_interface=127.24.71.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.252.keytab
--principal=kudu/127.24.71.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:44963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:46183,127.24.71.253:45921,127.24.71.252:38189
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:00:33.744474 12488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } attempt: 3
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for kudu/127.24.71.253@KRBTEST.COM
I20260808 10:00:33.753039 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.744879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:45921 (local address 127.0.0.1:48230)
0808 10:00:33.744944 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.744960 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:33.745031 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:33.745214 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:33.745216 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:33.745414 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:33.745489 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.745491 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.746428 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.746429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.747235 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.747238 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.747810 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.747812 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.747885 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.748452 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:33.748458 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:33.750070 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:33.752022 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.752024 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.752024 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.752227 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.752414 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.752415 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.752415 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.752467 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.752721 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:33.752722 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:33.752767 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 10:00:33.752824 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 10:00:33.752932 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 10:00:33.753360 12605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.745007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48230 (local address 127.24.71.253:45921)
0808 10:00:33.745076 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.745078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.745088 (+ 10us) server_negotiation.cc:407] Connection header received
0808 10:00:33.745119 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.745120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.745133 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.745189 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.745596 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.746329 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.747331 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.747686 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.747749 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.750172 (+ 2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.750173 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.750173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.750181 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.751929 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.752298 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.752299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.752299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.752352 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.752524 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.752525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.752525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.752646 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.752699 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.753180 (+ 481us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.753265 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 10:00:33.753748 12488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:00:33.754137 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.754034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38482)
0808 10:00:33.754078 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.754108 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 10:00:33.754515 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.754440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38498)
0808 10:00:33.754472 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.754495 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260808 10:00:33.754597 12488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:38189: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
I20260808 10:00:33.763038 12601 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } attempt: 1
I20260808 10:00:33.763530 12603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.763352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38512)
0808 10:00:33.763445 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.763491 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 10:00:33.763900 12603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.763791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38526)
0808 10:00:33.763845 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.763878 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 10:00:33.763996 12601 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:38189: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
I20260808 10:00:33.785763 12488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } attempt: 1
I20260808 10:00:33.786288 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.786137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38536)
0808 10:00:33.786201 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.786241 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 10:00:33.786701 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.786607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38552)
0808 10:00:33.786650 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.786675 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 10:00:33.786789 12488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:38189: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
I20260808 10:00:33.832156 12601 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } attempt: 2
I20260808 10:00:33.832715 12603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.832547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38554)
0808 10:00:33.832624 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.832676 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 10:00:33.833122 12603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.833020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38556)
0808 10:00:33.833070 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.833099 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 10:00:33.833273 12601 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:38189: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
W20260808 10:00:33.836740 12608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:33.836964 12608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:33.837013 12608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:33.838240 12608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:00:33.838304 12608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:33.838331 12608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:33.838361 12608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:00:33.838387 12608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:00:33.840039 12608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:44963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:46183,127.24.71.253:45921,127.24.71.252:38189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.252.keytab
--principal=kudu/127.24.71.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.252:38189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.71.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:33.840327 12608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:33.840555 12608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:33.845541 12624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:33.845525 12623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:33.845541 12627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:33.845737 12608 server_base.cc:1034] running on GCE node
I20260808 10:00:33.845983 12608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:33.846237 12608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:33.847451 12608 hybrid_clock.cc:648] HybridClock initialized: now 1786183233847434 us; error 39 us; skew 500 ppm
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:33.850206 12608 init.cc:377] Logged in from keytab as kudu/127.24.71.252@KRBTEST.COM (short username kudu)
I20260808 10:00:33.850664 12608 webserver.cc:460] Webserver started at http://127.24.71.252:44701/ using document root <none> and password file <none>
I20260808 10:00:33.850924 12608 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:33.850971 12608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:33.851130 12608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:00:33.852402 12608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/data/instance:
uuid: "55586e9758fc4ceb8e14d43e4ebf61f1"
format_stamp: "Formatted at 2026-08-08 10:00:33 on dist-test-slave-gw5c"
server_key: "bdbdac441ef3297eae8c426c3c968c7b"
server_key_iv: "916a1a097561345a542980f5a9d55170"
server_key_version: "encryptionkey@0"
I20260808 10:00:33.852787 12608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/wal/instance:
uuid: "55586e9758fc4ceb8e14d43e4ebf61f1"
format_stamp: "Formatted at 2026-08-08 10:00:33 on dist-test-slave-gw5c"
server_key: "bdbdac441ef3297eae8c426c3c968c7b"
server_key_iv: "916a1a097561345a542980f5a9d55170"
server_key_version: "encryptionkey@0"
I20260808 10:00:33.854180 12608 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 10:00:33.854993 12637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:33.855209 12608 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:00:33.855321 12608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/wal
uuid: "55586e9758fc4ceb8e14d43e4ebf61f1"
format_stamp: "Formatted at 2026-08-08 10:00:33 on dist-test-slave-gw5c"
server_key: "bdbdac441ef3297eae8c426c3c968c7b"
server_key_iv: "916a1a097561345a542980f5a9d55170"
server_key_version: "encryptionkey@0"
I20260808 10:00:33.855435 12608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:33.861968 12488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } attempt: 2
I20260808 10:00:33.862438 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.862302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38562)
0808 10:00:33.862364 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.862406 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 10:00:33.862821 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.862711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38578)
0808 10:00:33.862774 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.862803 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 10:00:33.862918 12488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:38189: Network error: Client connection negotiation failed: client connection to 127.24.71.252:38189: connect: Connection refused (error 111)
I20260808 10:00:33.868589 12608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:33.870896 12608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:33.871083 12608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:33.875211 12608 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.252:38189
I20260808 10:00:33.875245 12726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.252:38189 every 8 connection(s)
I20260808 10:00:33.875671 12608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/data/info.pb
I20260808 10:00:33.876600 12728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:33.878206 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 12608
I20260808 10:00:33.878342 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786183068256695-24863-0/minicluster-data/master-2/wal/instance
I20260808 10:00:33.878557 24863 external_mini_cluster.cc:1428] Setting key 9797866e34d9035484a6684616bca651
I20260808 10:00:33.878494 12728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.252@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.252@KRBTEST.COM
I20260808 10:00:33.889369 12493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.879291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37386 (local address 127.24.71.254:46183)
0808 10:00:33.879335 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.879337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.879605 (+ 268us) server_negotiation.cc:407] Connection header received
0808 10:00:33.880023 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.880025 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.880036 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.880090 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.880887 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.881718 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.882944 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.883271 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.883359 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.885894 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.885895 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.885896 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.885904 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.887729 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.888289 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.888290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.888290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.888351 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.888650 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.888651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.888651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.888771 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.888871 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.889167 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.889274 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 10:00:33.889528 12738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.879223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:46183 (local address 127.0.0.1:37386)
0808 10:00:33.879476 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.879523 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:33.879927 (+ 404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:33.880126 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:33.880129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:33.880528 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:33.880775 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.880782 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.881820 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.881821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.882839 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.882842 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.883370 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.883371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.883531 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.884063 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:33.884114 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:33.885802 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:33.887812 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.887817 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.887819 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.888187 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.888450 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.888451 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.888452 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.888569 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.888860 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:33.888869 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:33.889008 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 10:00:33.889118 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 10:00:33.889294 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":74,"threads_started":1}
I20260808 10:00:33.889998 12737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.879130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38580 (local address 127.24.71.252:38189)
0808 10:00:33.879345 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.879354 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.879390 (+ 36us) server_negotiation.cc:407] Connection header received
0808 10:00:33.879901 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.879908 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.879927 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.880075 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.880889 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.882054 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.883054 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.883537 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.883596 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.886438 (+ 2842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.886447 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.886447 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.886454 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.888334 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.888685 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.888688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.888688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.888748 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.889005 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.889006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.889007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.889163 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.889353 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.889397 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.889879 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":80,"threads_started":1}
I20260808 10:00:33.890300 12728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.252@KRBTEST.COM for kudu/127.24.71.253@KRBTEST.COM
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:33.897639 12605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.890726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48234 (local address 127.24.71.253:45921)
0808 10:00:33.890790 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.890793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.890802 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:00:33.890964 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.890965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.890977 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.891028 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.891309 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.891867 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.892544 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.892757 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.892841 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.894767 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.894768 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.894769 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.894775 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.896478 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.896800 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.896801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.896801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.896864 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.897049 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.897050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.897050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.897195 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.897256 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.897467 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.897558 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 10:00:33.897639 12738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.890638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:45921 (local address 127.0.0.1:48234)
0808 10:00:33.890672 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.890683 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:33.890727 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:33.891031 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:33.891032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:33.891170 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:33.891211 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.891212 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.891949 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.891950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.892455 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.892456 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.892837 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.892838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.892907 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.893424 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:33.893429 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:33.894676 (+ 1247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:33.896562 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.896563 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.896563 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.896724 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.896939 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.896940 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.896940 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.896991 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.897278 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:33.897279 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:33.897329 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 10:00:33.897414 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 10:00:33.897513 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 10:00:33.898030 12728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:00:33.898722 12493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.890780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37396 (local address 127.24.71.254:46183)
0808 10:00:33.890818 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.890819 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.890830 (+ 11us) server_negotiation.cc:407] Connection header received
0808 10:00:33.890903 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.890904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.890913 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.890962 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.891478 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.891945 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.892604 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.892802 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.892877 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.895471 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.895472 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.895472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.895479 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.897049 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.897443 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.897444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.897445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.897504 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.898076 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.898077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.898077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.898236 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.898494 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.898535 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.898619 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.252@KRBTEST.COM for kudu/127.24.71.252@KRBTEST.COM
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.253@KRBTEST.COM
I20260808 10:00:33.905831 12738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.898315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38592)
0808 10:00:33.898384 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.898395 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:33.898435 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:33.898561 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:33.898562 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:33.898708 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:33.898745 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.898746 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.899520 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.899521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.900258 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.900260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.900689 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.900689 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.900745 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.901089 (+ 344us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:33.901094 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:33.902513 (+ 1419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:33.904163 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.904164 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.904164 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.904441 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.904701 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.904702 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.904702 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.904768 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.905112 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:33.905114 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:33.905482 (+ 368us) client_negotiation.cc:769] Sending connection context
0808 10:00:33.905573 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 10:00:33.905677 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 10:00:33.906152 12737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.898348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38592 (local address 127.24.71.252:38189)
0808 10:00:33.898386 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.898388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.898425 (+ 37us) server_negotiation.cc:407] Connection header received
0808 10:00:33.898493 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.898494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.898504 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.898560 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.898828 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.899450 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.900333 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.900617 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.900687 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.902614 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.902616 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.902616 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.902623 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.904070 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.904530 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.904531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.904532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.904602 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.904855 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.904856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.904856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.905012 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.905123 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.905607 (+ 484us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.905768 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":18}
I20260808 10:00:33.907871 12605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.899418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48250 (local address 127.24.71.253:45921)
0808 10:00:33.899456 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.899457 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.899465 (+ 8us) server_negotiation.cc:407] Connection header received
0808 10:00:33.899487 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.899488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.899498 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.899544 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.900089 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.900688 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.901628 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.901931 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.902010 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.904930 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.904932 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.904932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.904938 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.906708 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.907076 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.907077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.907077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.907136 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.907313 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.907313 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.907314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.907454 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.907652 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.907693 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.907772 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 10:00:33.908125 12728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1: Bootstrap starting.
I20260808 10:00:33.909260 12728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:33.909610 12728 log.cc:824] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:33.910401 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:00:33.910614 12728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1: No bootstrap required, opened a new log
I20260808 10:00:33.913123 12728 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } }
I20260808 10:00:33.913291 12728 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:33.913340 12728 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55586e9758fc4ceb8e14d43e4ebf61f1, State: Initialized, Role: FOLLOWER
I20260808 10:00:33.913497 12728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } }
I20260808 10:00:33.913822 12728 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 10:00:33.916061 12766 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 10:00:33.916139 12766 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 10:00:33.916010 12608 master_runner.cc:186] Error getting master registration for 127.24.71.254:46183: OK, instance_id { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" instance_seqno: 1786183233516953 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 10:00:33.919551 12608 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 10:00:33.920632 12605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.912230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48266 (local address 127.24.71.253:45921)
0808 10:00:33.912272 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.912273 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.912411 (+ 138us) server_negotiation.cc:407] Connection header received
0808 10:00:33.912505 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.912506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.912515 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.912543 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.913430 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.914110 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.915319 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.915631 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.915700 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.917360 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.917362 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.917362 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.917369 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.919131 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.919678 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.919679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.919680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.919741 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.919965 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.919966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.919967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.920093 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.920209 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.920456 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.920536 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 10:00:33.921977 12493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.912093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37406 (local address 127.24.71.254:46183)
0808 10:00:33.912137 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.912139 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.912362 (+ 223us) server_negotiation.cc:407] Connection header received
0808 10:00:33.912441 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.912442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.912455 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.912512 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.913461 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.914197 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.915382 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.915687 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.915733 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.918047 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.918048 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.918048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.918057 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.920162 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.920926 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.920928 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.920928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.920993 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.921269 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.921270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.921270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.921423 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.921502 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.921758 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.921844 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 10:00:33.922272 12748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } } }
I20260808 10:00:33.922382 12748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:00:33.924458 12601 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } attempt: 3
I20260808 10:00:33.924940 12737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.912050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38598 (local address 127.24.71.252:38189)
0808 10:00:33.912131 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.912133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.912254 (+ 121us) server_negotiation.cc:407] Connection header received
0808 10:00:33.912535 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.912536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.912547 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.912581 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.913575 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.914257 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.919801 (+ 5544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.920124 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.920172 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.921691 (+ 1519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.921693 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.921694 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.921701 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.923356 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.923793 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.923795 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.923795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.923855 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.924049 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.924050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.924051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.924219 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.924319 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.924709 (+ 390us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.924829 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.253@KRBTEST.COM for kudu/127.24.71.252@KRBTEST.COM
I20260808 10:00:33.931746 12737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.924872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38612 (local address 127.24.71.252:38189)
0808 10:00:33.925024 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.925025 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.925035 (+ 10us) server_negotiation.cc:407] Connection header received
0808 10:00:33.925056 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.925057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.925067 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.925129 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.925492 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.925949 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.926658 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.926934 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.927003 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.929171 (+ 2168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.929172 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.929173 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.929179 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.930485 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.930910 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.930911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.930912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.930972 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.931184 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.931185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.931186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.931308 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.931408 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.931568 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.931648 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":121,"threads_started":1}
I20260808 10:00:33.931746 12603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.924739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38612)
0808 10:00:33.924785 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.924796 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:33.924835 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:33.925181 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:33.925182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:33.925345 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:33.925388 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.925391 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.926037 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.926038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.926534 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.926536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.927056 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.927058 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.927119 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.927680 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:33.927685 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:33.929087 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:33.930585 (+ 1498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.930587 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.930587 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.930814 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.931047 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.931048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.931048 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.931114 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.931380 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:33.931381 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:33.931445 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 10:00:33.931542 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 10:00:33.931648 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 10:00:33.933175 12601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac: Bootstrap starting.
I20260808 10:00:33.933859 12601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:33.934171 12601 log.cc:824] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:33.934955 12601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac: No bootstrap required, opened a new log
I20260808 10:00:33.936586 12601 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } }
I20260808 10:00:33.936725 12601 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:33.936775 12601 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afb9c1843354e46b1801adb4806f7ac, State: Initialized, Role: FOLLOWER
I20260808 10:00:33.936942 12601 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } }
I20260808 10:00:33.937245 12771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } } }
I20260808 10:00:33.937302 12601 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:00:33.937335 12771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [sys.catalog]: This master's current role is: FOLLOWER
W20260808 10:00:33.939369 12790 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 10:00:33.939479 12790 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 10:00:33.939352 12500 master_runner.cc:186] Error getting master registration for 127.24.71.254:46183: OK, instance_id { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" instance_seqno: 1786183233516953 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 10:00:33.941134 12500 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 10:00:33.962075 12488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } attempt: 3
Aug 08 10:00:33 dist-test-slave-gw5c krb5kdc[12361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183233, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for kudu/127.24.71.252@KRBTEST.COM
I20260808 10:00:33.969121 12737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.962508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38628 (local address 127.24.71.252:38189)
0808 10:00:33.962551 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:33.962553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:33.962562 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:00:33.962635 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:33.962636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:33.962648 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:33.962719 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:33.963048 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.963614 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.964288 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.964476 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.964553 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.966463 (+ 1910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:33.966465 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:33.966465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:33.966474 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:33.967897 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.968282 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.968284 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.968284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.968345 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:33.968575 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:33.968576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:33.968576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:33.968690 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:33.968778 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:33.968935 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 10:00:33.969014 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 10:00:33.969121 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:33.962452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:38189 (local address 127.0.0.1:38628)
0808 10:00:33.962513 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:33.962526 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:33.962570 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:33.962725 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:33.962726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:33.962920 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:33.962967 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.962969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.963697 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.963699 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.964192 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:33.964193 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:33.964550 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:33.964551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:33.964612 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:33.965128 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:33.965133 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:33.966370 (+ 1237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:33.968002 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.968003 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.968004 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.968186 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.968414 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:33.968415 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:33.968415 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:33.968482 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:33.968767 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:33.968768 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:33.968815 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 10:00:33.968908 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 10:00:33.969014 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 10:00:33.971021 12488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df: Bootstrap starting.
I20260808 10:00:33.971850 12488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:33.972178 12488 log.cc:824] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:33.973161 12488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df: No bootstrap required, opened a new log
I20260808 10:00:33.974651 12488 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } }
I20260808 10:00:33.974788 12488 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:33.974834 12488 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6ca89dc3b405aa75698f7ce1787df, State: Initialized, Role: FOLLOWER
I20260808 10:00:33.974965 12488 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } }
I20260808 10:00:33.975248 12794 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } } }
I20260808 10:00:33.975318 12488 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:00:33.975384 12794 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [sys.catalog]: This master's current role is: FOLLOWER
W20260808 10:00:33.977252 12808 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 10:00:33.977361 12808 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 10:00:33.979846 12378 master_runner.cc:263] No leader master found from master c0e6ca89dc3b405aa75698f7ce1787df
I20260808 10:00:33.979903 12378 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 10:00:34.014663 12413 tablet.cc:2369] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 10:00:34.121889 12651 tablet.cc:2369] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 10:00:34.186285 12531 tablet.cc:2369] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:00:34.207146 12794 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:00:34.207279 12794 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } }
I20260808 10:00:34.207593 12794 leader_election.cc:288] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0afb9c1843354e46b1801adb4806f7ac (127.24.71.253:45921), 55586e9758fc4ceb8e14d43e4ebf61f1 (127.24.71.252:38189)
I20260808 10:00:34.207893 12563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afb9c1843354e46b1801adb4806f7ac" is_pre_election: true
I20260808 10:00:34.207911 12685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" is_pre_election: true
I20260808 10:00:34.208066 12563 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6ca89dc3b405aa75698f7ce1787df in term 0.
I20260808 10:00:34.208079 12685 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6ca89dc3b405aa75698f7ce1787df in term 0.
I20260808 10:00:34.208351 12406 leader_election.cc:302] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55586e9758fc4ceb8e14d43e4ebf61f1, c0e6ca89dc3b405aa75698f7ce1787df; no voters:
I20260808 10:00:34.208479 12794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 10:00:34.208540 12794 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 10:00:34.208564 12794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:34.209374 12794 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } }
I20260808 10:00:34.209517 12794 leader_election.cc:288] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [CANDIDATE]: Term 1 election: Requested vote from peers 0afb9c1843354e46b1801adb4806f7ac (127.24.71.253:45921), 55586e9758fc4ceb8e14d43e4ebf61f1 (127.24.71.252:38189)
I20260808 10:00:34.209645 12563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afb9c1843354e46b1801adb4806f7ac"
I20260808 10:00:34.209728 12563 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:34.209750 12685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1"
I20260808 10:00:34.209832 12685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:34.210533 12685 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6ca89dc3b405aa75698f7ce1787df in term 1.
I20260808 10:00:34.210547 12563 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6ca89dc3b405aa75698f7ce1787df in term 1.
I20260808 10:00:34.210736 12405 leader_election.cc:302] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afb9c1843354e46b1801adb4806f7ac, c0e6ca89dc3b405aa75698f7ce1787df; no voters:
I20260808 10:00:34.210865 12794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:00:34.211023 12794 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [term 1 LEADER]: Becoming Leader. State: Replica: c0e6ca89dc3b405aa75698f7ce1787df, State: Running, Role: LEADER
I20260808 10:00:34.211119 12794 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } }
I20260808 10:00:34.211580 12810 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0e6ca89dc3b405aa75698f7ce1787df. Latest consensus state: current_term: 1 leader_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } } }
I20260808 10:00:34.211681 12810 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:34.211894 12813 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:00:34.212117 12813 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:00:34.213693 12685 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [term 1 FOLLOWER]: Refusing update from remote peer c0e6ca89dc3b405aa75698f7ce1787df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:00:34.213717 12563 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [term 1 FOLLOWER]: Refusing update from remote peer c0e6ca89dc3b405aa75698f7ce1787df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:00:34.214015 12810 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:00:34.214109 12794 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [LEADER]: Connected to new peer: Peer: permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:00:34.215175 12748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0e6ca89dc3b405aa75698f7ce1787df. Latest consensus state: current_term: 1 leader_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } } }
I20260808 10:00:34.215299 12748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:00:34.215375 12771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0e6ca89dc3b405aa75698f7ce1787df. Latest consensus state: current_term: 1 leader_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } } }
I20260808 10:00:34.215480 12771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:00:34.216071 12794 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } } }
I20260808 10:00:34.216152 12794 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:34.216375 12748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } } }
I20260808 10:00:34.216459 12748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:00:34.216538 12813 catalog_manager.cc:1347] Generated new cluster ID: f9e7af4e82384e9099fdd0b13230997a
I20260808 10:00:34.216593 12813 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:00:34.216761 12829 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } } }
I20260808 10:00:34.216853 12829 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:34.217191 12771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6ca89dc3b405aa75698f7ce1787df" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 46183 } } peers { permanent_uuid: "0afb9c1843354e46b1801adb4806f7ac" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 45921 } } peers { permanent_uuid: "55586e9758fc4ceb8e14d43e4ebf61f1" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 38189 } } }
I20260808 10:00:34.217275 12771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:00:34.233975 12813 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:00:34.234696 12813 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:00:34.238246 12813 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0e6ca89dc3b405aa75698f7ce1787df: Generated new TSK 0
I20260808 10:00:34.238687 12813 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:00:34.916623 12766 catalog_manager.cc:1259] Loaded cluster ID: f9e7af4e82384e9099fdd0b13230997a
I20260808 10:00:34.916707 12766 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1: loading cluster ID for follower catalog manager: success
I20260808 10:00:34.917531 12766 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1: acquiring CA information for follower catalog manager: success
I20260808 10:00:34.917814 12766 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 55586e9758fc4ceb8e14d43e4ebf61f1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 10:00:34.939922 12790 catalog_manager.cc:1259] Loaded cluster ID: f9e7af4e82384e9099fdd0b13230997a
I20260808 10:00:34.940022 12790 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac: loading cluster ID for follower catalog manager: success
I20260808 10:00:34.940842 12790 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac: acquiring CA information for follower catalog manager: success
I20260808 10:00:34.941179 12790 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0afb9c1843354e46b1801adb4806f7ac: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 10:00:35.295656 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 12378
I20260808 10:00:35.311221 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 12500
I20260808 10:00:35.322624 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 12608
2026-08-08T10:00:35Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3326 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:00:35 dist-test-slave-gw5c krb5kdc[12843](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:00:35 dist-test-slave-gw5c krb5kdc[12843](info): set up 2 sockets
Aug 08 10:00:35 dist-test-slave-gw5c krb5kdc[12843](info): commencing operation
krb5kdc: starting...
W20260808 10:00:36.566310 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:00:36 dist-test-slave-gw5c krb5kdc[12843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:00:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:00:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:00:36.694658 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:44997
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:44529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:44997
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:36.777920 12864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:36.778137 12864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:36.778160 12864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:36.779270 12864 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:00:36.779310 12864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:36.779325 12864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:36.779337 12864 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:00:36.779349 12864 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:00:36.780884 12864 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:44529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:44997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:44997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:36.781093 12864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:36.781265 12864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:36.786087 12873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:36.786109 12875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:36.786109 12871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:36.786342 12864 server_base.cc:1034] running on GCE node
I20260808 10:00:36.786614 12864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:36.786850 12864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:36.787985 12864 hybrid_clock.cc:648] HybridClock initialized: now 1786183236787950 us; error 51 us; skew 500 ppm
Aug 08 10:00:36 dist-test-slave-gw5c krb5kdc[12843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183236, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:36.790506 12864 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:00:36.790916 12864 webserver.cc:460] Webserver started at http://127.24.71.254:35083/ using document root <none> and password file <none>
I20260808 10:00:36.791098 12864 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:36.791142 12864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:36.791235 12864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:00:36.792366 12864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "f2215a997dc646f6a665e21c55aad0c9"
format_stamp: "Formatted at 2026-08-08 10:00:36 on dist-test-slave-gw5c"
server_key: "e131a040689da200def1e07b6566b6d8"
server_key_iv: "c54c6950ea3a1fec0600a582eeb269f6"
server_key_version: "encryptionkey@0"
I20260808 10:00:36.792672 12864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "f2215a997dc646f6a665e21c55aad0c9"
format_stamp: "Formatted at 2026-08-08 10:00:36 on dist-test-slave-gw5c"
server_key: "e131a040689da200def1e07b6566b6d8"
server_key_iv: "c54c6950ea3a1fec0600a582eeb269f6"
server_key_version: "encryptionkey@0"
I20260808 10:00:36.794021 12864 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:00:36.794809 12885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:36.795001 12864 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:00:36.795095 12864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "f2215a997dc646f6a665e21c55aad0c9"
format_stamp: "Formatted at 2026-08-08 10:00:36 on dist-test-slave-gw5c"
server_key: "e131a040689da200def1e07b6566b6d8"
server_key_iv: "c54c6950ea3a1fec0600a582eeb269f6"
server_key_version: "encryptionkey@0"
I20260808 10:00:36.795176 12864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:36.809502 12864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:36.811951 12864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:36.812115 12864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:36.816151 12864 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:44997
I20260808 10:00:36.816226 12962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:44997 every 8 connection(s)
I20260808 10:00:36.816592 12864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:00:36.817624 12963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:36.820243 12963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9: Bootstrap starting.
I20260808 10:00:36.820389 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 12864
I20260808 10:00:36.820494 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:00:36.820745 24863 external_mini_cluster.cc:1428] Setting key cb1b8a6a42b7882af4dbca514f4c9cf2
I20260808 10:00:36.821062 12963 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:36.821458 12963 log.cc:824] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:36.822211 12963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9: No bootstrap required, opened a new log
I20260808 10:00:36.824203 12963 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2215a997dc646f6a665e21c55aad0c9" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 44997 } }
I20260808 10:00:36.824381 12963 raft_consensus.cc:374] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:36.824432 12963 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2215a997dc646f6a665e21c55aad0c9, State: Initialized, Role: FOLLOWER
I20260808 10:00:36.824608 12963 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2215a997dc646f6a665e21c55aad0c9" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 44997 } }
I20260808 10:00:36.824708 12963 raft_consensus.cc:388] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:00:36.824759 12963 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:00:36.824807 12963 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:36.825430 12963 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2215a997dc646f6a665e21c55aad0c9" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 44997 } }
I20260808 10:00:36.825562 12963 leader_election.cc:302] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2215a997dc646f6a665e21c55aad0c9; no voters:
I20260808 10:00:36.825765 12963 leader_election.cc:288] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:00:36.825794 12972 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:00:36.826092 12972 raft_consensus.cc:686] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [term 1 LEADER]: Becoming Leader. State: Replica: f2215a997dc646f6a665e21c55aad0c9, State: Running, Role: LEADER
I20260808 10:00:36.826215 12963 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:00:36.826253 12972 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2215a997dc646f6a665e21c55aad0c9" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 44997 } }
I20260808 10:00:36.826745 12972 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2215a997dc646f6a665e21c55aad0c9. Latest consensus state: current_term: 1 leader_uuid: "f2215a997dc646f6a665e21c55aad0c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2215a997dc646f6a665e21c55aad0c9" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 44997 } } }
I20260808 10:00:36.826959 12972 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:36.826890 12974 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2215a997dc646f6a665e21c55aad0c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2215a997dc646f6a665e21c55aad0c9" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 44997 } } }
I20260808 10:00:36.827220 12974 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:36.827693 12988 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 08 10:00:36 dist-test-slave-gw5c krb5kdc[12843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:36.828194 12988 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:00:36.829870 12988 catalog_manager.cc:1347] Generated new cluster ID: 36d5c3348b9b43aeaa2ecc2564674b87
I20260808 10:00:36.829931 12988 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:00:36.832376 12970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:36.821321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58164 (local address 127.24.71.254:44997)
0808 10:00:36.821543 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:36.821552 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:36.821587 (+ 35us) server_negotiation.cc:407] Connection header received
0808 10:00:36.822035 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:36.822042 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:36.822087 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:36.822242 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:36.822915 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:36.823869 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:36.824725 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:36.825223 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:36.825354 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:36.828399 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:36.828403 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:36.828403 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:36.828417 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:36.830632 (+ 2215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:36.831055 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:36.831059 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:36.831059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:36.831177 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:36.831415 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:36.831417 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:36.831417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:36.831752 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:36.831916 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:36.832008 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 10:00:36.832160 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":91,"threads_started":1}
I20260808 10:00:36.833422 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:00:36.853367 12988 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:00:36.854135 12988 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:00:36.856935 12988 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f2215a997dc646f6a665e21c55aad0c9: Generated new TSK 0
I20260808 10:00:36.857148 12988 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:00:36.887846 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 12864
2026-08-08T10:00:36Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1563 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:00:36 dist-test-slave-gw5c krb5kdc[13006](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:00:36 dist-test-slave-gw5c krb5kdc[13006](info): set up 2 sockets
Aug 08 10:00:36 dist-test-slave-gw5c krb5kdc[13006](info): commencing operation
krb5kdc: starting...
W20260808 10:00:38.145265 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:00:38 dist-test-slave-gw5c krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:00:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:00:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:00:38.274773 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33791
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:33791
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:38.357683 13030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:38.357947 13030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:38.357990 13030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:38.359161 13030 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:00:38.359236 13030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:38.359261 13030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:38.359282 13030 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:00:38.359309 13030 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:00:38.360908 13030 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:33791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:38.361194 13030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:38.361440 13030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:38.366168 13039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:38.366178 13044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:38.366190 13040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:38.366484 13030 server_base.cc:1034] running on GCE node
I20260808 10:00:38.366744 13030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:38.366981 13030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:38.368121 13030 hybrid_clock.cc:648] HybridClock initialized: now 1786183238368112 us; error 33 us; skew 500 ppm
Aug 08 10:00:38 dist-test-slave-gw5c krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183238, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:38.370633 13030 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:00:38.371150 13030 webserver.cc:460] Webserver started at http://127.24.71.254:39215/ using document root <none> and password file <none>
I20260808 10:00:38.371434 13030 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:38.371517 13030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:38.371659 13030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:00:38.372689 13030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "b24c43f6247c4e989a8284b6a6df0076"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "237c05d3d4fa341a3d70d95236077ffa"
server_key_iv: "e2d92f851106c34bda3e4e1b97c23912"
server_key_version: "encryptionkey@0"
I20260808 10:00:38.373060 13030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "b24c43f6247c4e989a8284b6a6df0076"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "237c05d3d4fa341a3d70d95236077ffa"
server_key_iv: "e2d92f851106c34bda3e4e1b97c23912"
server_key_version: "encryptionkey@0"
I20260808 10:00:38.374377 13030 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:00:38.375131 13052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:38.375299 13030 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:00:38.375423 13030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "b24c43f6247c4e989a8284b6a6df0076"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "237c05d3d4fa341a3d70d95236077ffa"
server_key_iv: "e2d92f851106c34bda3e4e1b97c23912"
server_key_version: "encryptionkey@0"
I20260808 10:00:38.375496 13030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:38.389353 13030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:38.391542 13030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:38.391717 13030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:38.396166 13030 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:33791
I20260808 10:00:38.396226 13132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:33791 every 8 connection(s)
I20260808 10:00:38.396617 13030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:00:38.397675 13133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:38.400209 13133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Bootstrap starting.
I20260808 10:00:38.400230 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 13030
I20260808 10:00:38.400311 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:00:38.400540 24863 external_mini_cluster.cc:1428] Setting key 09562ff9fed01e30175af3781c2d55d0
I20260808 10:00:38.401007 13133 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:38.401407 13133 log.cc:824] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:38.402163 13133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: No bootstrap required, opened a new log
I20260808 10:00:38.404533 13133 raft_consensus.cc:348] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } }
I20260808 10:00:38.404678 13133 raft_consensus.cc:374] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:38.404702 13133 raft_consensus.cc:729] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b24c43f6247c4e989a8284b6a6df0076, State: Initialized, Role: FOLLOWER
I20260808 10:00:38.404842 13133 consensus_queue.cc:260] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } }
I20260808 10:00:38.404927 13133 raft_consensus.cc:388] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:00:38.404949 13133 raft_consensus.cc:482] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:00:38.405023 13133 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:38.405691 13133 raft_consensus.cc:504] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } }
I20260808 10:00:38.405810 13133 leader_election.cc:302] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b24c43f6247c4e989a8284b6a6df0076; no voters:
I20260808 10:00:38.405970 13133 leader_election.cc:288] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:00:38.406034 13140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:00:38.406194 13140 raft_consensus.cc:686] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 1 LEADER]: Becoming Leader. State: Replica: b24c43f6247c4e989a8284b6a6df0076, State: Running, Role: LEADER
I20260808 10:00:38.406270 13133 sys_catalog.cc:564] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:00:38.406365 13140 consensus_queue.cc:237] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } }
I20260808 10:00:38.406757 13140 sys_catalog.cc:455] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b24c43f6247c4e989a8284b6a6df0076. Latest consensus state: current_term: 1 leader_uuid: "b24c43f6247c4e989a8284b6a6df0076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } } }
I20260808 10:00:38.406876 13140 sys_catalog.cc:458] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:38.407560 13142 sys_catalog.cc:455] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b24c43f6247c4e989a8284b6a6df0076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } } }
I20260808 10:00:38.407706 13142 sys_catalog.cc:458] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:38.408010 13154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 08 10:00:38 dist-test-slave-gw5c krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:38.408535 13154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:00:38.410743 13154 catalog_manager.cc:1347] Generated new cluster ID: 64d3266fa06a40d1ab4fd8126c23cdde
I20260808 10:00:38.410799 13154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:00:38.413576 13138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.401103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36266 (local address 127.24.71.254:33791)
0808 10:00:38.401330 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:38.401340 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:38.401377 (+ 37us) server_negotiation.cc:407] Connection header received
0808 10:00:38.401982 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:38.401991 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:38.402055 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:38.402216 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:38.402847 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.404355 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.405345 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.405974 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.406453 (+ 479us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.409137 (+ 2684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:38.409143 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:38.409143 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:38.409157 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:38.411378 (+ 2221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:38.411823 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:38.411826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:38.411827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:38.411936 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:38.412150 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:38.412151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:38.412152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:38.412465 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:38.412634 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:38.413191 (+ 557us) server_negotiation.cc:299] Negotiation successful
0808 10:00:38.413355 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":92,"threads_started":1}
I20260808 10:00:38.421195 13154 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:00:38.421923 13154 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:00:38.427481 13154 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Generated new TSK 0
I20260808 10:00:38.427682 13154 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 10:00:38.458488 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33791
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:38.543795 13174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:38.544034 13174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:38.544071 13174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:38.545233 13174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:38.545301 13174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:38.545356 13174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:00:38.546839 13174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:38.547107 13174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:38.547356 13174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:38.552399 13191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:38.552590 13174 server_base.cc:1034] running on GCE node
W20260808 10:00:38.552412 13183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:38.552443 13182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:38.552902 13174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:38.553171 13174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:38.554342 13174 hybrid_clock.cc:648] HybridClock initialized: now 1786183238554341 us; error 39 us; skew 500 ppm
Aug 08 10:00:38 dist-test-slave-gw5c krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183238, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:38.556932 13174 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 10:00:38.557343 13174 webserver.cc:460] Webserver started at http://127.24.71.193:44991/ using document root <none> and password file <none>
I20260808 10:00:38.557531 13174 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:38.557571 13174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:38.557662 13174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:00:38.558691 13174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "f0f3b5a919fa45339fafffc36c108091"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "7064136d423efb6e5d8b22d516deda3e"
server_key_iv: "676cb399906dbd033002b37dd75bbcfb"
server_key_version: "encryptionkey@0"
I20260808 10:00:38.559021 13174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "f0f3b5a919fa45339fafffc36c108091"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "7064136d423efb6e5d8b22d516deda3e"
server_key_iv: "676cb399906dbd033002b37dd75bbcfb"
server_key_version: "encryptionkey@0"
I20260808 10:00:38.560436 13174 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 10:00:38.561134 13200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:38.561342 13174 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 10:00:38.561444 13174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "f0f3b5a919fa45339fafffc36c108091"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "7064136d423efb6e5d8b22d516deda3e"
server_key_iv: "676cb399906dbd033002b37dd75bbcfb"
server_key_version: "encryptionkey@0"
I20260808 10:00:38.561501 13174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:38.576216 13174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:38.578676 13174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:38.578850 13174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:38.579116 13174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:38.579474 13174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:38.579512 13174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:38.579535 13174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:38.579547 13174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:38.585347 13174 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:33183
I20260808 10:00:38.585445 13384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:33183 every 8 connection(s)
I20260808 10:00:38.585762 13174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
Aug 08 10:00:38 dist-test-slave-gw5c krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183238, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:38.594415 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 13174
I20260808 10:00:38.594521 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 10:00:38.594727 24863 external_mini_cluster.cc:1428] Setting key 5a4e39476814d14477a108ff3cf4f014
I20260808 10:00:38.595335 13138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.586609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:60019 (local address 127.24.71.254:33791)
0808 10:00:38.586682 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:38.586684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:38.586926 (+ 242us) server_negotiation.cc:407] Connection header received
0808 10:00:38.587446 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:38.587447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:38.587459 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:38.587524 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:38.588486 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.589029 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.590039 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.590238 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.590289 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.592396 (+ 2107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:38.592398 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:38.592398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:38.592405 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:38.593820 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:38.594195 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:38.594195 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:38.594196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:38.594246 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:38.594616 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:38.594616 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:38.594617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:38.594742 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:38.594831 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:38.595181 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 10:00:38.595252 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 10:00:38.595639 13388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.586592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:60019)
0808 10:00:38.586790 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:38.586827 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:38.587313 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:38.587582 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:38.587585 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:38.588183 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:38.588385 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:38.588390 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.589142 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.589143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:38.589959 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:38.589961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.590315 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.590316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:38.590415 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.590879 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:38.590887 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:38.592307 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:38.593893 (+ 1586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:38.593900 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:38.593901 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:38.594115 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:38.594323 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:38.594324 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:38.594324 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:38.594488 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:38.594878 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:38.594886 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:38.595030 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 10:00:38.595159 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 10:00:38.595330 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":107,"threads_started":1}
I20260808 10:00:38.596150 13385 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33791
I20260808 10:00:38.596246 13385 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:38.596447 13385 heartbeater.cc:511] Master 127.24.71.254:33791 requested a full tablet report, sending...
I20260808 10:00:38.597020 13075 ts_manager.cc:194] Registered new tserver with Master: f0f3b5a919fa45339fafffc36c108091 (127.24.71.193:33183)
I20260808 10:00:38.597769 13075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:60019
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 10:00:38.622493 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33791
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:38.708638 13392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:38.708896 13392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:38.708940 13392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:38.710129 13392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:38.710203 13392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:38.710250 13392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:00:38.711836 13392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:38.712158 13392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:38.712420 13392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:38.717734 13404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:38.717772 13402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:38.717775 13401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:38.718070 13392 server_base.cc:1034] running on GCE node
I20260808 10:00:38.718302 13392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:38.718554 13392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:38.719717 13392 hybrid_clock.cc:648] HybridClock initialized: now 1786183238719693 us; error 38 us; skew 500 ppm
Aug 08 10:00:38 dist-test-slave-gw5c krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183238, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:38.725929 13392 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 10:00:38.726393 13392 webserver.cc:460] Webserver started at http://127.24.71.194:39999/ using document root <none> and password file <none>
I20260808 10:00:38.726634 13392 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:38.726703 13392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:38.726866 13392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:00:38.728068 13392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "f3d092d6e46c45d8af8b81153a3f9e8b"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "2c798ae9d0d371d345201da9f776250b"
server_key_iv: "0ccf4d6842b5d8de98e8426759c91594"
server_key_version: "encryptionkey@0"
I20260808 10:00:38.728459 13392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "f3d092d6e46c45d8af8b81153a3f9e8b"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "2c798ae9d0d371d345201da9f776250b"
server_key_iv: "0ccf4d6842b5d8de98e8426759c91594"
server_key_version: "encryptionkey@0"
I20260808 10:00:38.729823 13392 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:00:38.730577 13419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:38.730754 13392 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:00:38.730882 13392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "f3d092d6e46c45d8af8b81153a3f9e8b"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "2c798ae9d0d371d345201da9f776250b"
server_key_iv: "0ccf4d6842b5d8de98e8426759c91594"
server_key_version: "encryptionkey@0"
I20260808 10:00:38.730963 13392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:38.755172 13392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:38.757803 13392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:38.757984 13392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:38.758309 13392 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:38.758661 13392 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:38.758718 13392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:38.758754 13392 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:38.758781 13392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:38.765609 13392 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:36719
I20260808 10:00:38.765693 13606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:36719 every 8 connection(s)
I20260808 10:00:38.766083 13392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 10:00:38.768461 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 13392
I20260808 10:00:38.768579 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 10:00:38.768813 24863 external_mini_cluster.cc:1428] Setting key 0653a0c3faf95bf96f0a3783dd5c0f21
Aug 08 10:00:38 dist-test-slave-gw5c krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183238, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:38.777686 13138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.767034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:44779 (local address 127.24.71.254:33791)
0808 10:00:38.767113 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:38.767116 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:38.767457 (+ 341us) server_negotiation.cc:407] Connection header received
0808 10:00:38.768111 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:38.768112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:38.768125 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:38.768184 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:38.769514 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.770056 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.771608 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.771938 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.772023 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.774474 (+ 2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:38.774475 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:38.774475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:38.774482 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:38.776022 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:38.776582 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:38.776583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:38.776583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:38.776653 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:38.776980 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:38.776980 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:38.776981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:38.777086 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:38.777140 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:38.777517 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 10:00:38.777606 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 10:00:38.777961 13610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.767002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:44779)
0808 10:00:38.767259 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:38.767337 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:38.767995 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:38.768259 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:38.768264 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:38.769128 (+ 864us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:38.769393 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:38.769398 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.770170 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.770171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:38.771501 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:38.771505 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.772030 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.772031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:38.772136 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.772748 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:38.772756 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:38.774375 (+ 1619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:38.776116 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:38.776125 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:38.776128 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:38.776484 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:38.776728 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:38.776729 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:38.776730 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:38.776903 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:38.777155 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:38.777164 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:38.777343 (+ 179us) client_negotiation.cc:769] Sending connection context
0808 10:00:38.777468 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 10:00:38.777680 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":98,"threads_started":1}
I20260808 10:00:38.778545 13607 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33791
I20260808 10:00:38.778694 13607 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:38.778884 13607 heartbeater.cc:511] Master 127.24.71.254:33791 requested a full tablet report, sending...
I20260808 10:00:38.779361 13075 ts_manager.cc:194] Registered new tserver with Master: f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719)
I20260808 10:00:38.779758 13075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:44779
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 10:00:38.798916 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33791
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:38.882602 13613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:38.882815 13613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:38.882839 13613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:38.883973 13613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:38.884011 13613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:38.884037 13613 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:00:38.885438 13613 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:38.885633 13613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:38.885821 13613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:38.890928 13622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:38.890909 13620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:38.890974 13613 server_base.cc:1034] running on GCE node
W20260808 10:00:38.890909 13627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:38.891368 13613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:38.891666 13613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:38.892818 13613 hybrid_clock.cc:648] HybridClock initialized: now 1786183238892799 us; error 35 us; skew 500 ppm
Aug 08 10:00:38 dist-test-slave-gw5c krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183238, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:38.895483 13613 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 10:00:38.895946 13613 webserver.cc:460] Webserver started at http://127.24.71.195:45265/ using document root <none> and password file <none>
I20260808 10:00:38.896195 13613 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:38.896241 13613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:38.896426 13613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:00:38.897500 13613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "a005504faeac41e18a0bb4127d57a94e"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "5f172c494e00e151ebe33a0fd58a0dae"
server_key_iv: "02f49df7b3000bd8ebbdf672b2705786"
server_key_version: "encryptionkey@0"
I20260808 10:00:38.897873 13613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "a005504faeac41e18a0bb4127d57a94e"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "5f172c494e00e151ebe33a0fd58a0dae"
server_key_iv: "02f49df7b3000bd8ebbdf672b2705786"
server_key_version: "encryptionkey@0"
I20260808 10:00:38.899250 13613 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 10:00:38.900070 13639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:38.900240 13613 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 10:00:38.900363 13613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "a005504faeac41e18a0bb4127d57a94e"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "5f172c494e00e151ebe33a0fd58a0dae"
server_key_iv: "02f49df7b3000bd8ebbdf672b2705786"
server_key_version: "encryptionkey@0"
I20260808 10:00:38.900444 13613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:38.932739 13613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:38.935249 13613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:38.935473 13613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:38.935738 13613 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:38.936069 13613 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:38.936124 13613 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:38.936172 13613 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:38.936206 13613 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:38.942480 13613 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:35047
I20260808 10:00:38.942525 13835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:35047 every 8 connection(s)
I20260808 10:00:38.942907 13613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 10:00:38.944868 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 13613
I20260808 10:00:38.944986 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 10:00:38.945161 24863 external_mini_cluster.cc:1428] Setting key 753d0663642acb7bc1c91025ffa02784
Aug 08 10:00:38 dist-test-slave-gw5c krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183238, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:38.953495 13138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.943865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:40451 (local address 127.24.71.254:33791)
0808 10:00:38.944234 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:38.944236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:38.944284 (+ 48us) server_negotiation.cc:407] Connection header received
0808 10:00:38.944921 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:38.944923 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:38.944935 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:38.944996 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:38.946163 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.946675 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.947813 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.948033 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.948122 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.950572 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:38.950573 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:38.950574 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:38.950582 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:38.952008 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:38.952452 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:38.952454 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:38.952454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:38.952520 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:38.952798 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:38.952799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:38.952800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:38.952935 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:38.953012 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:38.953303 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 10:00:38.953391 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339}
I20260808 10:00:38.953718 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.943829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:40451)
0808 10:00:38.944097 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:38.944170 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:38.944806 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:38.945075 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:38.945078 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:38.945802 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:38.946066 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:38.946072 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.946792 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.946793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:38.947679 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:38.947681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.948136 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.948137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:38.948286 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.948780 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:38.948789 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:38.950460 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:38.952109 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:38.952117 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:38.952119 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:38.952372 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:38.952595 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:38.952596 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:38.952596 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:38.952718 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:38.953018 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:38.953026 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:38.953170 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 10:00:38.953280 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 10:00:38.953470 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":112,"threads_started":1}
I20260808 10:00:38.954226 13837 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33791
I20260808 10:00:38.954314 13837 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:38.954514 13837 heartbeater.cc:511] Master 127.24.71.254:33791 requested a full tablet report, sending...
I20260808 10:00:38.954914 13075 ts_manager.cc:194] Registered new tserver with Master: a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047)
I20260808 10:00:38.955331 13075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:40451
I20260808 10:00:38.956874 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 10:00:38.964325 13138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.958270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36274 (local address 127.24.71.254:33791)
0808 10:00:38.958367 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:38.958369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:38.958423 (+ 54us) server_negotiation.cc:407] Connection header received
0808 10:00:38.958477 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:38.958478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:38.958487 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:38.958547 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:38.959119 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.959723 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.960438 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.960622 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.960682 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.961809 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:38.961810 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:38.961810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:38.961815 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:38.963224 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:38.963592 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:38.963593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:38.963594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:38.963645 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:38.963887 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:38.963888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:38.963888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:38.964034 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:38.964115 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:38.964203 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 10:00:38.964263 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 10:00:38.965970 13075 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36274:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 10:00:38.967742 13075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 10:00:38.974545 13860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.970587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58416 (local address 127.24.71.195:35047)
0808 10:00:38.970934 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:38.970938 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:38.970949 (+ 11us) server_negotiation.cc:407] Connection header received
0808 10:00:38.970990 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:38.970992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:38.971007 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:38.971094 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:38.971286 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.972178 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.973637 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.974133 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.974222 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.974282 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:38.974423 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 10:00:38.974462 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":95,"threads_started":1}
I20260808 10:00:38.974534 13856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.970359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:35047 (local address 127.0.0.1:58416)
0808 10:00:38.970552 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:38.970597 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:38.970673 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:38.971106 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:38.971106 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:38.971109 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:38.971169 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:38.971170 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.972287 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.972288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:38.973570 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:38.973573 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.974221 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.974222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:38.974303 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.974317 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 10:00:38.974389 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 10:00:38.974446 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":29,"thread_start_us":55,"threads_started":1}
I20260808 10:00:38.974550 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.970364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:33183 (local address 127.0.0.1:41886)
0808 10:00:38.970658 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:38.970667 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:38.970710 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:38.971441 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:38.971442 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:38.971444 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:38.971479 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:38.971480 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.972385 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.972386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:38.973271 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:38.973274 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.974313 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.974314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:38.974381 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.974385 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:00:38.974430 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 10:00:38.974470 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":16,"thread_start_us":107,"threads_started":1}
I20260808 10:00:38.974731 13859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.970455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41886 (local address 127.24.71.193:33183)
0808 10:00:38.971249 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:38.971253 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:38.971263 (+ 10us) server_negotiation.cc:407] Connection header received
0808 10:00:38.971303 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:38.971305 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:38.971320 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:38.971437 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:38.971534 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.972277 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.973368 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.974151 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.974222 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.974279 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:38.974586 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 10:00:38.974632 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":747,"thread_start_us":114,"threads_started":1}
I20260808 10:00:38.975600 13857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.970393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:36719 (local address 127.0.0.1:59472)
0808 10:00:38.970807 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:38.970818 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:38.970909 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:38.971078 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:38.971082 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:38.971084 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:38.971161 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:38.971163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.973582 (+ 2419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.973583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:38.974614 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:38.974616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.975329 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.975330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:38.975420 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.975425 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 10:00:38.975492 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 10:00:38.975535 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":101,"threads_started":1}
I20260808 10:00:38.975924 13862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:38.970640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59472 (local address 127.24.71.194:36719)
0808 10:00:38.970846 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:38.970851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:38.970923 (+ 72us) server_negotiation.cc:407] Connection header received
0808 10:00:38.970971 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:38.970973 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:38.970986 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:38.971051 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:38.972327 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.973477 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.974705 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:38.975226 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:38.975325 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:38.975413 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:38.975791 (+ 378us) server_negotiation.cc:299] Negotiation successful
0808 10:00:38.975845 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":89,"threads_started":1}
I20260808 10:00:38.975800 13278 tablet_service.cc:1467] Processing CreateTablet for tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2 (DEFAULT_TABLE table=test-table [id=de9e8da3de844d28830252704bb643f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:00:38.975919 13717 tablet_service.cc:1467] Processing CreateTablet for tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2 (DEFAULT_TABLE table=test-table [id=de9e8da3de844d28830252704bb643f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:00:38.976219 13278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:38.976292 13717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:38.979102 13866 tablet_bootstrap.cc:492] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Bootstrap starting.
I20260808 10:00:38.979234 13864 tablet_bootstrap.cc:492] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e: Bootstrap starting.
I20260808 10:00:38.979539 13497 tablet_service.cc:1467] Processing CreateTablet for tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2 (DEFAULT_TABLE table=test-table [id=de9e8da3de844d28830252704bb643f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:00:38.979893 13497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:38.979910 13866 tablet_bootstrap.cc:654] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:38.980109 13864 tablet_bootstrap.cc:654] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:38.980520 13866 log.cc:824] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:38.980645 13864 log.cc:824] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:38.981367 13866 tablet_bootstrap.cc:492] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: No bootstrap required, opened a new log
I20260808 10:00:38.981429 13864 tablet_bootstrap.cc:492] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e: No bootstrap required, opened a new log
I20260808 10:00:38.981453 13866 ts_tablet_manager.cc:1397] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 10:00:38.981482 13864 ts_tablet_manager.cc:1397] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 10:00:38.983244 13871 tablet_bootstrap.cc:492] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b: Bootstrap starting.
I20260808 10:00:38.983559 13864 raft_consensus.cc:348] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } }
I20260808 10:00:38.983559 13866 raft_consensus.cc:348] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } }
I20260808 10:00:38.983738 13866 raft_consensus.cc:374] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:38.983738 13864 raft_consensus.cc:374] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:38.983786 13864 raft_consensus.cc:729] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a005504faeac41e18a0bb4127d57a94e, State: Initialized, Role: FOLLOWER
I20260808 10:00:38.983786 13866 raft_consensus.cc:729] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f3b5a919fa45339fafffc36c108091, State: Initialized, Role: FOLLOWER
I20260808 10:00:38.983909 13866 consensus_queue.cc:260] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } }
I20260808 10:00:38.983906 13864 consensus_queue.cc:260] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } }
I20260808 10:00:38.983997 13871 tablet_bootstrap.cc:654] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:38.984208 13864 ts_tablet_manager.cc:1428] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 10:00:38.984208 13866 ts_tablet_manager.cc:1428] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 10:00:38.984267 13385 heartbeater.cc:503] Master 127.24.71.254:33791 was elected leader, sending a full tablet report...
I20260808 10:00:38.984325 13837 heartbeater.cc:503] Master 127.24.71.254:33791 was elected leader, sending a full tablet report...
I20260808 10:00:38.984620 13871 log.cc:824] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:38.985596 13871 tablet_bootstrap.cc:492] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b: No bootstrap required, opened a new log
I20260808 10:00:38.985674 13871 ts_tablet_manager.cc:1397] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 10:00:38.987252 13871 raft_consensus.cc:348] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } }
I20260808 10:00:38.987442 13871 raft_consensus.cc:374] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:38.987488 13871 raft_consensus.cc:729] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d092d6e46c45d8af8b81153a3f9e8b, State: Initialized, Role: FOLLOWER
I20260808 10:00:38.987612 13871 consensus_queue.cc:260] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } }
I20260808 10:00:38.987906 13871 ts_tablet_manager.cc:1428] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 10:00:38.987931 13607 heartbeater.cc:503] Master 127.24.71.254:33791 was elected leader, sending a full tablet report...
W20260808 10:00:39.016708 13608 tablet.cc:2369] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 10:00:39.086555 13387 tablet.cc:2369] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:00:39.101154 13880 raft_consensus.cc:482] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:00:39.101277 13880 raft_consensus.cc:504] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } }
I20260808 10:00:39.101771 13880 leader_election.cc:288] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047), f0f3b5a919fa45339fafffc36c108091 (127.24.71.193:33183)
I20260808 10:00:39.105697 13859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.102038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:51457 (local address 127.24.71.193:33183)
0808 10:00:39.102096 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.102098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.102109 (+ 11us) server_negotiation.cc:407] Connection header received
0808 10:00:39.102139 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.102140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.102150 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.102209 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:39.102454 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.103260 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.104753 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.105316 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.105398 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.105408 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:39.105593 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 10:00:39.105631 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 10:00:39.105712 13860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.102117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:38277 (local address 127.24.71.195:35047)
0808 10:00:39.102174 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.102176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.102432 (+ 256us) server_negotiation.cc:407] Connection header received
0808 10:00:39.102466 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.102467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.102480 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.102549 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:39.102688 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.103437 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.104753 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.105319 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.105399 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.105408 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:39.105581 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 10:00:39.105624 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 10:00:39.105705 13610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.101970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:33183 (local address 127.24.71.194:51457)
0808 10:00:39.102019 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:39.102030 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:39.102079 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:39.102247 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:39.102248 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:39.102251 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:39.102342 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.102344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.103348 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.103349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.104651 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.104654 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.105406 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.105407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.105499 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.105501 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 10:00:39.105573 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 10:00:39.105610 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":7}
I20260808 10:00:39.105712 13885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.101979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:35047 (local address 127.24.71.194:38277)
0808 10:00:39.102312 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:39.102323 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:39.102400 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:39.102556 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:39.102557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:39.102558 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:39.102615 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.102616 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.103499 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.103500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.104652 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.104654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.105406 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.105407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.105494 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.105499 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 10:00:39.105561 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 10:00:39.105609 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":157,"thread_start_us":116,"threads_started":1}
I20260808 10:00:39.106170 13753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4919bf63f8eb498a8a6e5eb6fd2a71a2" candidate_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a005504faeac41e18a0bb4127d57a94e" is_pre_election: true
I20260808 10:00:39.106187 13315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4919bf63f8eb498a8a6e5eb6fd2a71a2" candidate_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f3b5a919fa45339fafffc36c108091" is_pre_election: true
I20260808 10:00:39.106362 13753 raft_consensus.cc:2454] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d092d6e46c45d8af8b81153a3f9e8b in term 0.
I20260808 10:00:39.106365 13315 raft_consensus.cc:2454] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d092d6e46c45d8af8b81153a3f9e8b in term 0.
I20260808 10:00:39.106606 13422 leader_election.cc:302] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a005504faeac41e18a0bb4127d57a94e, f3d092d6e46c45d8af8b81153a3f9e8b; no voters:
I20260808 10:00:39.106740 13880 raft_consensus.cc:2781] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 10:00:39.106793 13880 raft_consensus.cc:482] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 10:00:39.106817 13880 raft_consensus.cc:3037] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:39.107681 13880 raft_consensus.cc:504] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } }
I20260808 10:00:39.107893 13880 leader_election.cc:288] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [CANDIDATE]: Term 1 election: Requested vote from peers a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047), f0f3b5a919fa45339fafffc36c108091 (127.24.71.193:33183)
I20260808 10:00:39.108100 13315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4919bf63f8eb498a8a6e5eb6fd2a71a2" candidate_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f3b5a919fa45339fafffc36c108091"
I20260808 10:00:39.108192 13315 raft_consensus.cc:3037] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:39.108978 13315 raft_consensus.cc:2454] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d092d6e46c45d8af8b81153a3f9e8b in term 1.
I20260808 10:00:39.109131 13753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4919bf63f8eb498a8a6e5eb6fd2a71a2" candidate_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a005504faeac41e18a0bb4127d57a94e"
I20260808 10:00:39.109203 13423 leader_election.cc:302] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0f3b5a919fa45339fafffc36c108091, f3d092d6e46c45d8af8b81153a3f9e8b; no voters:
I20260808 10:00:39.109225 13753 raft_consensus.cc:3037] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:39.109360 13880 raft_consensus.cc:2781] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:00:39.109563 13880 raft_consensus.cc:686] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [term 1 LEADER]: Becoming Leader. State: Replica: f3d092d6e46c45d8af8b81153a3f9e8b, State: Running, Role: LEADER
I20260808 10:00:39.109678 13880 consensus_queue.cc:237] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } }
I20260808 10:00:39.110180 13753 raft_consensus.cc:2454] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d092d6e46c45d8af8b81153a3f9e8b in term 1.
I20260808 10:00:39.110764 13074 catalog_manager.cc:5495] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194). New cstate: current_term: 1 leader_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } health_report { overall_health: HEALTHY } } }
I20260808 10:00:39.119581 13862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.117063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59476 (local address 127.24.71.194:36719)
0808 10:00:39.117133 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.117135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.117144 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:00:39.117188 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.117188 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.117205 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.117300 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:00:39.117451 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.117924 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.118696 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.118904 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.118995 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.119175 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:00:39.119279 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:00:39.119377 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:39.119445 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 10:00:39.119466 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 10:00:39.121481 13753 raft_consensus.cc:1261] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e [term 1 FOLLOWER]: Refusing update from remote peer f3d092d6e46c45d8af8b81153a3f9e8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:00:39.121482 13315 raft_consensus.cc:1261] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Refusing update from remote peer f3d092d6e46c45d8af8b81153a3f9e8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:00:39.121829 13880 consensus_queue.cc:1035] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:00:39.122000 13886 consensus_queue.cc:1035] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:00:39.125248 13891 mvcc.cc:205] Tried to move back new op lower bound from 7316206547438694400 to 7316206547393884160. Current Snapshot: MvccSnapshot[applied={T|T < 7316206547438694400 or (T in {7316206547438694400})}]
I20260808 10:00:39.125521 13894 mvcc.cc:205] Tried to move back new op lower bound from 7316206547438694400 to 7316206547393884160. Current Snapshot: MvccSnapshot[applied={T|T < 7316206547438694400 or (T in {7316206547438694400})}]
I20260808 10:00:39.126825 13074 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:00:39.126924 13074 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:00:39.127775 13074 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Sending DeleteTablet for 3 replicas of tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2
I20260808 10:00:39.128123 13717 tablet_service.cc:1514] Processing DeleteTablet for tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:39 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:58416
I20260808 10:00:39.128122 13497 tablet_service.cc:1514] Processing DeleteTablet for tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:39 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:59472
I20260808 10:00:39.128131 13278 tablet_service.cc:1514] Processing DeleteTablet for tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:39 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:41886
I20260808 10:00:39.128401 13910 tablet_replica.cc:330] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: stopping tablet replica
I20260808 10:00:39.128417 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 13174
I20260808 10:00:39.128533 13909 tablet_replica.cc:330] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e: stopping tablet replica
I20260808 10:00:39.128636 13909 raft_consensus.cc:2229] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:00:39.128734 13909 raft_consensus.cc:2258] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:00:39.132682 13909 ts_tablet_manager.cc:1905] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:00:39.135121 13909 ts_tablet_manager.cc:1918] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:00:39.135223 13909 log.cc:1196] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/4919bf63f8eb498a8a6e5eb6fd2a71a2
I20260808 10:00:39.135615 13909 ts_tablet_manager.cc:1939] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P a005504faeac41e18a0bb4127d57a94e: Deleting consensus metadata
I20260808 10:00:39.136201 13053 catalog_manager.cc:4841] TS a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047): tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2 (table test-table [id=de9e8da3de844d28830252704bb643f5]) successfully deleted
I20260808 10:00:39.136482 13904 tablet_replica.cc:330] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b: stopping tablet replica
I20260808 10:00:39.136632 13904 raft_consensus.cc:2229] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [term 1 LEADER]: Raft consensus shutting down.
I20260808 10:00:39.136773 13904 raft_consensus.cc:2258] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:00:39.138536 13904 ts_tablet_manager.cc:1905] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:00:39.141052 13904 ts_tablet_manager.cc:1918] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:00:39.141147 13904 log.cc:1196] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/4919bf63f8eb498a8a6e5eb6fd2a71a2
I20260808 10:00:39.141525 13904 ts_tablet_manager.cc:1939] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f3d092d6e46c45d8af8b81153a3f9e8b: Deleting consensus metadata
W20260808 10:00:39.147817 13056 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:33183 (error 108)
I20260808 10:00:39.147938 13057 catalog_manager.cc:4841] TS f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719): tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2 (table test-table [id=de9e8da3de844d28830252704bb643f5]) successfully deleted
I20260808 10:00:39.148468 13857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.148308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:33183 (local address 127.0.0.1:41894)
0808 10:00:39.148383 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:39.148429 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:33183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 10:00:39.148558 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 13392
W20260808 10:00:39.148602 13056 catalog_manager.cc:4584] TS f0f3b5a919fa45339fafffc36c108091 (127.24.71.193:33183): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2: Network error: Client connection negotiation failed: client connection to 127.24.71.193:33183: connect: Connection refused (error 111)
I20260808 10:00:39.169859 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 13613
I20260808 10:00:39.178988 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 13030
I20260808 10:00:39.188723 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33791
--webserver_interface=127.24.71.254
--webserver_port=39215
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:33791
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:39.272585 13915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:39.272809 13915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:39.272833 13915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:39.274024 13915 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:00:39.274071 13915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:39.274085 13915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:39.274098 13915 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:00:39.274158 13915 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:00:39.275655 13915 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:33791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=39215
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:39.275923 13915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:39.276168 13915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:39.286080 13921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:39.286198 13915 server_base.cc:1034] running on GCE node
W20260808 10:00:39.286108 13922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:39.286273 13924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:39.286556 13915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:39.286834 13915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:39.287976 13915 hybrid_clock.cc:648] HybridClock initialized: now 1786183239287962 us; error 27 us; skew 500 ppm
Aug 08 10:00:39 dist-test-slave-gw5c krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183239, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:39.290568 13915 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:00:39.291090 13915 webserver.cc:460] Webserver started at http://127.24.71.254:39215/ using document root <none> and password file <none>
I20260808 10:00:39.291338 13915 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:39.291460 13915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:39.292900 13915 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:00:39.293587 13938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:39.293782 13915 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 10:00:39.293895 13915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "b24c43f6247c4e989a8284b6a6df0076"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "237c05d3d4fa341a3d70d95236077ffa"
server_key_iv: "e2d92f851106c34bda3e4e1b97c23912"
server_key_version: "encryptionkey@0"
I20260808 10:00:39.294301 13915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:39.309938 13915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:39.312232 13915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:39.312381 13915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:39.317111 13915 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:33791
I20260808 10:00:39.317193 14021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:33791 every 8 connection(s)
I20260808 10:00:39.317612 13915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:00:39.319470 14023 sys_catalog.cc:263] Verifying existing consensus state
I20260808 10:00:39.320195 14023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Bootstrap starting.
I20260808 10:00:39.324530 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 13915
I20260808 10:00:39.324885 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:33183
--local_ip_for_outbound_sockets=127.24.71.193
--tserver_master_addrs=127.24.71.254:33791
--webserver_port=44991
--webserver_interface=127.24.71.193
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:00:39.330319 14023 log.cc:824] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:39.332471 14023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 10:00:39.332805 14023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Bootstrap complete.
I20260808 10:00:39.335251 14023 raft_consensus.cc:348] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } }
I20260808 10:00:39.335558 14023 raft_consensus.cc:729] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b24c43f6247c4e989a8284b6a6df0076, State: Initialized, Role: FOLLOWER
I20260808 10:00:39.335752 14023 consensus_queue.cc:260] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } }
I20260808 10:00:39.335834 14023 raft_consensus.cc:388] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:00:39.335901 14023 raft_consensus.cc:482] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:00:39.335951 14023 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 1 FOLLOWER]: Advancing to term 2
I20260808 10:00:39.336990 14023 raft_consensus.cc:504] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } }
I20260808 10:00:39.337119 14023 leader_election.cc:302] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b24c43f6247c4e989a8284b6a6df0076; no voters:
I20260808 10:00:39.337330 14023 leader_election.cc:288] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 10:00:39.337409 14031 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 10:00:39.337616 14023 sys_catalog.cc:564] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:00:39.337615 14031 raft_consensus.cc:686] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 2 LEADER]: Becoming Leader. State: Replica: b24c43f6247c4e989a8284b6a6df0076, State: Running, Role: LEADER
I20260808 10:00:39.337898 14031 consensus_queue.cc:237] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } }
I20260808 10:00:39.338171 14032 sys_catalog.cc:455] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b24c43f6247c4e989a8284b6a6df0076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } } }
I20260808 10:00:39.338236 14032 sys_catalog.cc:458] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:39.338512 14033 sys_catalog.cc:455] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b24c43f6247c4e989a8284b6a6df0076. Latest consensus state: current_term: 2 leader_uuid: "b24c43f6247c4e989a8284b6a6df0076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } } }
I20260808 10:00:39.338563 14033 sys_catalog.cc:458] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:39.338766 14040 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:00:39.339679 14040 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:00:39.339809 14040 catalog_manager.cc:1259] Loaded cluster ID: 64d3266fa06a40d1ab4fd8126c23cdde
I20260808 10:00:39.339883 14040 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:00:39.340444 14040 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 10:00:39.345686 14040 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 10:00:39.348443 14040 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:00:39.348645 14040 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Loaded TSK: 0
I20260808 10:00:39.348866 14040 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 10:00:39.417237 14026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:39.417501 14026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:39.417544 14026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:39.418768 14026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:39.418859 14026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:39.418912 14026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:00:39.420639 14026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:33183
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=44991
--tserver_master_addrs=127.24.71.254:33791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:39.420979 14026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:39.421237 14026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:39.427536 14066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:39.427474 14067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:39.427471 14073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:39.427765 14026 server_base.cc:1034] running on GCE node
I20260808 10:00:39.428013 14026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:39.428280 14026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:39.429468 14026 hybrid_clock.cc:648] HybridClock initialized: now 1786183239429446 us; error 47 us; skew 500 ppm
Aug 08 10:00:39 dist-test-slave-gw5c krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183239, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:39.432394 14026 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 10:00:39.432955 14026 webserver.cc:460] Webserver started at http://127.24.71.193:44991/ using document root <none> and password file <none>
I20260808 10:00:39.433240 14026 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:39.433305 14026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:39.434784 14026 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 10:00:39.435612 14082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:39.435823 14026 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:00:39.435923 14026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "f0f3b5a919fa45339fafffc36c108091"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "7064136d423efb6e5d8b22d516deda3e"
server_key_iv: "676cb399906dbd033002b37dd75bbcfb"
server_key_version: "encryptionkey@0"
I20260808 10:00:39.436305 14026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:39.448215 14026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:39.450596 14026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:39.450778 14026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:39.451047 14026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:39.451599 14089 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 10:00:39.453733 14026 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 10:00:39.453822 14026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 10:00:39.453866 14026 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 10:00:39.454583 14026 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 10:00:39.454644 14026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 10:00:39.454734 14089 tablet_bootstrap.cc:492] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Bootstrap starting.
I20260808 10:00:39.462925 14026 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:33183
I20260808 10:00:39.462977 14254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:33183 every 8 connection(s)
I20260808 10:00:39.463506 14026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 10:00:39.467717 14089 log.cc:824] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:39.470703 14089 tablet_bootstrap.cc:492] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 10:00:39.471041 14089 tablet_bootstrap.cc:492] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Bootstrap complete.
I20260808 10:00:39.471452 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 14026
I20260808 10:00:39.471736 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:36719
--local_ip_for_outbound_sockets=127.24.71.194
--tserver_master_addrs=127.24.71.254:33791
--webserver_port=39999
--webserver_interface=127.24.71.194
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:00:39.472599 14089 ts_tablet_manager.cc:1397] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.011s
I20260808 10:00:39.474107 14089 raft_consensus.cc:348] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } }
I20260808 10:00:39.474514 14089 raft_consensus.cc:729] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f3b5a919fa45339fafffc36c108091, State: Initialized, Role: FOLLOWER
I20260808 10:00:39.474687 14089 consensus_queue.cc:260] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } }
I20260808 10:00:39.475041 14089 ts_tablet_manager.cc:1428] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
Aug 08 10:00:39 dist-test-slave-gw5c krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183239, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:39.480441 14263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.464404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:44615 (local address 127.24.71.254:33791)
0808 10:00:39.468154 (+ 3750us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.468185 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.468245 (+ 60us) server_negotiation.cc:407] Connection header received
0808 10:00:39.468945 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.468953 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.469023 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.469187 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:39.470048 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.471534 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.473114 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.473735 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.473858 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.476683 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:39.476688 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:39.476688 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:39.476709 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:39.478466 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:39.478950 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:39.478953 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:39.478956 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:39.479077 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:39.479362 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:39.479364 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:39.479364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:39.479662 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:39.479760 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:39.480091 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 10:00:39.480227 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3681,"thread_start_us":75,"threads_started":1}
I20260808 10:00:39.480454 14262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.464292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:44615)
0808 10:00:39.467682 (+ 3390us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:39.467736 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:39.468659 (+ 923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:39.469236 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:39.469240 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:39.469624 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:39.469892 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.469900 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.471673 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.471674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.473006 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.473009 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.473965 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.473966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.474112 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.474773 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:39.474784 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:39.476557 (+ 1773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:39.478582 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:39.478591 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:39.478593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:39.478841 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:39.479154 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:39.479155 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:39.479156 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:39.479279 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:39.479749 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:39.479757 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:39.479909 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 10:00:39.480027 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 10:00:39.480221 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3337,"thread_start_us":112,"threads_started":1}
I20260808 10:00:39.481858 14255 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33791
I20260808 10:00:39.481983 14255 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:39.482184 14255 heartbeater.cc:511] Master 127.24.71.254:33791 requested a full tablet report, sending...
I20260808 10:00:39.482986 13970 ts_manager.cc:194] Registered new tserver with Master: f0f3b5a919fa45339fafffc36c108091 (127.24.71.193:33183)
I20260808 10:00:39.484215 13970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:44615
I20260808 10:00:39.485086 14255 heartbeater.cc:503] Master 127.24.71.254:33791 was elected leader, sending a full tablet report...
I20260808 10:00:39.490655 14268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.483684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:33183 (local address 127.0.0.1:41902)
0808 10:00:39.487521 (+ 3837us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:39.487553 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:39.487608 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:39.487932 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:39.487935 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:39.487937 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:39.488006 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.488008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.488886 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.488887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.489685 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.489688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.490348 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.490350 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.490436 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.490449 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 10:00:39.490521 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 10:00:39.490581 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3801,"thread_start_us":100,"threads_started":1}
I20260808 10:00:39.490671 14269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.483958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41902 (local address 127.24.71.193:33183)
0808 10:00:39.487717 (+ 3759us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.487762 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.487774 (+ 12us) server_negotiation.cc:407] Connection header received
0808 10:00:39.487812 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.487814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.487829 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.487926 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:39.488099 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.488790 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.489782 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.490257 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.490356 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.490415 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:39.490542 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 10:00:39.490582 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3733,"thread_start_us":72,"threads_started":1}
I20260808 10:00:39.491492 14152 tablet_service.cc:1514] Processing DeleteTablet for tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:39 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:41902
I20260808 10:00:39.492101 14272 tablet_replica.cc:330] stopping tablet replica
I20260808 10:00:39.492240 14272 raft_consensus.cc:2229] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:00:39.492312 14272 raft_consensus.cc:2258] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:00:39.492630 14272 ts_tablet_manager.cc:1905] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:00:39.494822 14272 ts_tablet_manager.cc:1918] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:00:39.494941 14272 log.cc:1196] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal/wals/4919bf63f8eb498a8a6e5eb6fd2a71a2
I20260808 10:00:39.495209 14272 ts_tablet_manager.cc:1939] T 4919bf63f8eb498a8a6e5eb6fd2a71a2 P f0f3b5a919fa45339fafffc36c108091: Deleting consensus metadata
I20260808 10:00:39.495867 13940 catalog_manager.cc:4841] TS f0f3b5a919fa45339fafffc36c108091 (127.24.71.193:33183): tablet 4919bf63f8eb498a8a6e5eb6fd2a71a2 (table test-table [id=de9e8da3de844d28830252704bb643f5]) successfully deleted
W20260808 10:00:39.564247 14266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:39.564500 14266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:39.564528 14266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:39.565728 14266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:39.565765 14266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:39.565791 14266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:00:39.567232 14266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:36719
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=39999
--tserver_master_addrs=127.24.71.254:33791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:39.567523 14266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:39.567795 14266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:39.573045 14286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:39.573074 14284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:39.573088 14283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:39.573160 14266 server_base.cc:1034] running on GCE node
I20260808 10:00:39.573490 14266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:39.573755 14266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:39.574903 14266 hybrid_clock.cc:648] HybridClock initialized: now 1786183239574878 us; error 39 us; skew 500 ppm
Aug 08 10:00:39 dist-test-slave-gw5c krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183239, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:39.577597 14266 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 10:00:39.578094 14266 webserver.cc:460] Webserver started at http://127.24.71.194:39999/ using document root <none> and password file <none>
I20260808 10:00:39.578328 14266 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:39.578418 14266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:39.579913 14266 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:00:39.580534 14294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:39.580711 14266 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:00:39.580804 14266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "f3d092d6e46c45d8af8b81153a3f9e8b"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "2c798ae9d0d371d345201da9f776250b"
server_key_iv: "0ccf4d6842b5d8de98e8426759c91594"
server_key_version: "encryptionkey@0"
I20260808 10:00:39.581146 14266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:39.596118 14266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:39.598582 14266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:39.598701 14266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:39.598904 14266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:39.599241 14266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:39.599306 14266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:39.599354 14266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:39.599380 14266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:39.605507 14266 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:36719
I20260808 10:00:39.605619 14468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:36719 every 8 connection(s)
I20260808 10:00:39.605947 14266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 10:00:39.609599 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 14266
I20260808 10:00:39.609875 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:35047
--local_ip_for_outbound_sockets=127.24.71.195
--tserver_master_addrs=127.24.71.254:33791
--webserver_port=45265
--webserver_interface=127.24.71.195
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 10:00:39 dist-test-slave-gw5c krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183239, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:39.615979 14263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.606731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:39345 (local address 127.24.71.254:33791)
0808 10:00:39.606802 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.606804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.607051 (+ 247us) server_negotiation.cc:407] Connection header received
0808 10:00:39.607681 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.607682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.607696 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.607748 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:39.608725 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.609228 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.610420 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.610635 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.610722 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.612960 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:39.612962 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:39.612962 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:39.612970 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:39.614477 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:39.614922 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:39.614924 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:39.614924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:39.614988 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:39.615255 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:39.615256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:39.615256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:39.615435 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:39.615496 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:39.615788 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 10:00:39.615883 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 10:00:39.616166 14479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.606714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:39345)
0808 10:00:39.606924 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:39.606962 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:39.607565 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:39.607816 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:39.607820 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:39.608420 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:39.608609 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.608614 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.609328 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.609329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.610328 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.610331 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.610736 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.610737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.610873 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.611460 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:39.611469 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:39.612859 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:39.614579 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:39.614588 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:39.614590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:39.614837 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:39.615066 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:39.615067 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:39.615067 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:39.615178 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:39.615500 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:39.615509 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:39.615648 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 10:00:39.615755 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 10:00:39.615931 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":104,"threads_started":1}
I20260808 10:00:39.616899 14470 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33791
I20260808 10:00:39.617022 14470 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:39.617219 14470 heartbeater.cc:511] Master 127.24.71.254:33791 requested a full tablet report, sending...
I20260808 10:00:39.617704 13970 ts_manager.cc:194] Registered new tserver with Master: f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719)
I20260808 10:00:39.618096 13970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:39345
W20260808 10:00:39.696975 14481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:39.697247 14481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:39.697290 14481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:39.698541 14481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:39.698616 14481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:39.698663 14481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:00:39.700819 14481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:35047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=45265
--tserver_master_addrs=127.24.71.254:33791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:39.701097 14481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:39.701386 14481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:39.706856 14490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:39.706849 14487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:39.706972 14481 server_base.cc:1034] running on GCE node
W20260808 10:00:39.706849 14486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:39.707222 14481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:39.707492 14481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:39.708664 14481 hybrid_clock.cc:648] HybridClock initialized: now 1786183239708653 us; error 42 us; skew 500 ppm
Aug 08 10:00:39 dist-test-slave-gw5c krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183239, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:39.711352 14481 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 10:00:39.711899 14481 webserver.cc:460] Webserver started at http://127.24.71.195:45265/ using document root <none> and password file <none>
I20260808 10:00:39.712160 14481 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:39.712255 14481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:39.713702 14481 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:00:39.714387 14510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:39.714566 14481 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:00:39.714663 14481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "a005504faeac41e18a0bb4127d57a94e"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "5f172c494e00e151ebe33a0fd58a0dae"
server_key_iv: "02f49df7b3000bd8ebbdf672b2705786"
server_key_version: "encryptionkey@0"
I20260808 10:00:39.715050 14481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:39.736370 14481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:39.739115 14481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:39.739283 14481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:39.739580 14481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:39.739938 14481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:39.739995 14481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:39.740032 14481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:39.740059 14481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:39.746061 14481 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:35047
I20260808 10:00:39.746152 14708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:35047 every 8 connection(s)
I20260808 10:00:39.746476 14481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
Aug 08 10:00:39 dist-test-slave-gw5c krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183239, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:39.755836 14263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.747212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:34693 (local address 127.24.71.254:33791)
0808 10:00:39.747310 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.747313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.747535 (+ 222us) server_negotiation.cc:407] Connection header received
0808 10:00:39.748057 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.748058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.748068 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.748121 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:39.749033 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.749514 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.750464 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.750644 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.750692 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.752905 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:39.752906 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:39.752907 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:39.752915 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:39.754541 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:39.754931 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:39.754933 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:39.754933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:39.754995 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:39.755238 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:39.755239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:39.755239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:39.755347 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:39.755437 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:39.755699 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 10:00:39.755768 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 10:00:39.756008 14711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.747179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:34693)
0808 10:00:39.747372 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:39.747457 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:39.747968 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:39.748177 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:39.748181 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:39.748749 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:39.748958 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.748962 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.749594 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.749594 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.750388 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.750390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.750717 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.750717 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.750818 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.751314 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:39.751322 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:39.752792 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:39.754617 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:39.754623 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:39.754625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:39.754833 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:39.755063 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:39.755063 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:39.755064 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:39.755177 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:39.755448 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:39.755461 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:39.755580 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 10:00:39.755668 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 10:00:39.755789 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":104,"threads_started":1}
I20260808 10:00:39.756510 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 14481
I20260808 10:00:39.756639 14709 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33791
I20260808 10:00:39.756738 14709 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:39.756933 14709 heartbeater.cc:511] Master 127.24.71.254:33791 requested a full tablet report, sending...
I20260808 10:00:39.757351 13970 ts_manager.cc:194] Registered new tserver with Master: a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047)
I20260808 10:00:39.757881 13970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:34693
I20260808 10:00:39.763084 14263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.756932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36284 (local address 127.24.71.254:33791)
0808 10:00:39.756994 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.756996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.757102 (+ 106us) server_negotiation.cc:407] Connection header received
0808 10:00:39.757178 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.757179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.757207 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.757277 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:39.757990 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.758684 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.759494 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.759676 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.759729 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.760795 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:39.760796 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:39.760796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:39.760802 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:39.762224 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:39.762520 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:39.762521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:39.762521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:39.762572 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:39.762731 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:39.762732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:39.762732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:39.762818 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:39.762938 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:39.762969 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 10:00:39.763024 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 10:00:39.763813 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 10:00:39.766376 14263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.764183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36290 (local address 127.24.71.254:33791)
0808 10:00:39.764244 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.764246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.764385 (+ 139us) server_negotiation.cc:407] Connection header received
0808 10:00:39.764441 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.764442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.764472 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.764534 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:00:39.764622 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.765050 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.765769 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.765942 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.765992 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.766124 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:00:39.766218 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:00:39.766278 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:39.766309 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 10:00:39.766323 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 10:00:39.766637 13970 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:36290:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 10:00:39.768464 13970 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 10:00:39.770713 14152 tablet_service.cc:1467] Processing CreateTablet for tablet 17c3155bdae647f8817ee4989775d706 (DEFAULT_TABLE table=test-table [id=cf82aa7c9cf74d86a80c59b52c3adf04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:00:39.770965 14152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17c3155bdae647f8817ee4989775d706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:39.772801 14089 tablet_bootstrap.cc:492] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091: Bootstrap starting.
I20260808 10:00:39.773253 14089 tablet_bootstrap.cc:654] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:39.773991 14089 tablet_bootstrap.cc:492] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091: No bootstrap required, opened a new log
I20260808 10:00:39.774067 14089 ts_tablet_manager.cc:1397] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 10:00:39.774232 14089 raft_consensus.cc:348] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:39.774312 14089 raft_consensus.cc:374] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:39.774369 14089 raft_consensus.cc:729] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f3b5a919fa45339fafffc36c108091, State: Initialized, Role: FOLLOWER
I20260808 10:00:39.774423 14089 consensus_queue.cc:260] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:39.774524 14089 ts_tablet_manager.cc:1428] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:39.774753 14719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.770468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:36719 (local address 127.0.0.1:59478)
0808 10:00:39.770578 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:39.770590 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:39.770644 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:39.771683 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:39.771684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:39.771686 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:39.771728 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.771729 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.772580 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.772582 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.773539 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.773542 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.774515 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.774516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.774585 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.774591 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 10:00:39.774625 (+ 34us) client_negotiation.cc:240] Negotiation successful
0808 10:00:39.774674 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":65,"threads_started":1}
I20260808 10:00:39.774924 14268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.770432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:35047 (local address 127.0.0.1:58424)
0808 10:00:39.770548 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:39.770560 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:39.770601 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:39.771069 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:39.771070 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:39.771072 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:39.771105 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.771106 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.772529 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.772531 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.773657 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.773660 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.774669 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.774670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.774734 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.774738 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:00:39.774790 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 10:00:39.774838 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":48}
I20260808 10:00:39.775174 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.770701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58424 (local address 127.24.71.195:35047)
0808 10:00:39.770901 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.770906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.770918 (+ 12us) server_negotiation.cc:407] Connection header received
0808 10:00:39.770961 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.770963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.770980 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.771070 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:39.771152 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.772410 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.773913 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.774599 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.774667 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.774729 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:39.775041 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 10:00:39.775090 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":122,"threads_started":1}
I20260808 10:00:39.775192 14722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.770679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59478 (local address 127.24.71.194:36719)
0808 10:00:39.771530 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.771535 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.771546 (+ 11us) server_negotiation.cc:407] Connection header received
0808 10:00:39.771589 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.771591 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.771608 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.771688 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:39.771780 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.772456 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.773634 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.774406 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.774945 (+ 539us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.775023 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:39.775051 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 10:00:39.775101 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":810,"thread_start_us":120,"threads_started":1}
I20260808 10:00:39.775866 14360 tablet_service.cc:1467] Processing CreateTablet for tablet 17c3155bdae647f8817ee4989775d706 (DEFAULT_TABLE table=test-table [id=cf82aa7c9cf74d86a80c59b52c3adf04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:00:39.776242 14360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17c3155bdae647f8817ee4989775d706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:39.778926 14724 tablet_bootstrap.cc:492] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b: Bootstrap starting.
I20260808 10:00:39.779345 14596 tablet_service.cc:1467] Processing CreateTablet for tablet 17c3155bdae647f8817ee4989775d706 (DEFAULT_TABLE table=test-table [id=cf82aa7c9cf74d86a80c59b52c3adf04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:00:39.779664 14724 tablet_bootstrap.cc:654] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:39.779690 14596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17c3155bdae647f8817ee4989775d706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:39.780120 14724 log.cc:824] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:39.780803 14724 tablet_bootstrap.cc:492] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b: No bootstrap required, opened a new log
I20260808 10:00:39.780858 14724 ts_tablet_manager.cc:1397] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 10:00:39.782192 14727 tablet_bootstrap.cc:492] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e: Bootstrap starting.
I20260808 10:00:39.782320 14724 raft_consensus.cc:348] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:39.782491 14724 raft_consensus.cc:374] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:39.782539 14724 raft_consensus.cc:729] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d092d6e46c45d8af8b81153a3f9e8b, State: Initialized, Role: FOLLOWER
I20260808 10:00:39.782720 14724 consensus_queue.cc:260] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:39.782960 14727 tablet_bootstrap.cc:654] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:39.783041 14724 ts_tablet_manager.cc:1428] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 10:00:39.783068 14470 heartbeater.cc:503] Master 127.24.71.254:33791 was elected leader, sending a full tablet report...
I20260808 10:00:39.783918 14727 log.cc:824] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:39.784688 14727 tablet_bootstrap.cc:492] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e: No bootstrap required, opened a new log
I20260808 10:00:39.784747 14727 ts_tablet_manager.cc:1397] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 10:00:39.786109 14727 raft_consensus.cc:348] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:39.786237 14727 raft_consensus.cc:374] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:39.786258 14727 raft_consensus.cc:729] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a005504faeac41e18a0bb4127d57a94e, State: Initialized, Role: FOLLOWER
I20260808 10:00:39.786338 14727 consensus_queue.cc:260] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:39.786609 14727 ts_tablet_manager.cc:1428] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 10:00:39.786653 14709 heartbeater.cc:503] Master 127.24.71.254:33791 was elected leader, sending a full tablet report...
W20260808 10:00:39.856581 14474 tablet.cc:2369] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:00:39.967579 14267 raft_consensus.cc:482] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:00:39.967730 14267 raft_consensus.cc:504] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:39.968106 14267 leader_election.cc:288] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047), f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719)
W20260808 10:00:39.968411 14257 tablet.cc:2369] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:00:39.971804 14262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.968308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:35047 (local address 127.24.71.193:40067)
0808 10:00:39.968371 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:39.968383 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:39.968430 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:39.968700 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:39.968701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:39.968703 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:39.968777 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.968780 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.969447 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.969448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.970684 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.970687 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.971505 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.971506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.971606 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.971611 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 10:00:39.971672 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 10:00:39.971724 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 10:00:39.971832 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.968410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:40067 (local address 127.24.71.195:35047)
0808 10:00:39.968470 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.968472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.968481 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:00:39.968511 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.968512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.968522 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.968650 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:39.968870 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.969351 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.970779 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.971383 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.971504 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.971515 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:39.971697 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 10:00:39.971759 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 10:00:39.971880 14722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.968524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:56765 (local address 127.24.71.194:36719)
0808 10:00:39.968571 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.968596 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.968776 (+ 180us) server_negotiation.cc:407] Connection header received
0808 10:00:39.968871 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.968872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.968881 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.968926 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:39.969098 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.969620 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.970907 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.971540 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.971612 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.971619 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:39.971771 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 10:00:39.971810 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 10:00:39.972180 14740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.968309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:36719 (local address 127.24.71.193:56765)
0808 10:00:39.968691 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:39.968702 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:39.968793 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:39.968928 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:39.968929 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:39.968930 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:39.969026 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.969029 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.969708 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.969709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.970823 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:39.970825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:39.971633 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:39.971634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:39.971700 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:39.971704 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:00:39.971754 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 10:00:39.971785 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":13,"thread_start_us":78,"threads_started":1}
I20260808 10:00:39.972332 14627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17c3155bdae647f8817ee4989775d706" candidate_uuid: "f0f3b5a919fa45339fafffc36c108091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a005504faeac41e18a0bb4127d57a94e" is_pre_election: true
I20260808 10:00:39.972551 14627 raft_consensus.cc:2454] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f3b5a919fa45339fafffc36c108091 in term 0.
I20260808 10:00:39.972630 14392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17c3155bdae647f8817ee4989775d706" candidate_uuid: "f0f3b5a919fa45339fafffc36c108091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" is_pre_election: true
I20260808 10:00:39.972800 14392 raft_consensus.cc:2454] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f3b5a919fa45339fafffc36c108091 in term 0.
I20260808 10:00:39.972824 14083 leader_election.cc:302] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a005504faeac41e18a0bb4127d57a94e, f0f3b5a919fa45339fafffc36c108091; no voters:
I20260808 10:00:39.972950 14267 raft_consensus.cc:2781] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 10:00:39.973011 14267 raft_consensus.cc:482] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 10:00:39.973029 14267 raft_consensus.cc:3037] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:39.973810 14267 raft_consensus.cc:504] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:39.973971 14267 leader_election.cc:288] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 1 election: Requested vote from peers a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047), f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719)
I20260808 10:00:39.974171 14392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17c3155bdae647f8817ee4989775d706" candidate_uuid: "f0f3b5a919fa45339fafffc36c108091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b"
I20260808 10:00:39.974170 14627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17c3155bdae647f8817ee4989775d706" candidate_uuid: "f0f3b5a919fa45339fafffc36c108091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a005504faeac41e18a0bb4127d57a94e"
I20260808 10:00:39.974256 14392 raft_consensus.cc:3037] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:39.974256 14627 raft_consensus.cc:3037] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:39.975208 14627 raft_consensus.cc:2454] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f3b5a919fa45339fafffc36c108091 in term 1.
I20260808 10:00:39.975208 14392 raft_consensus.cc:2454] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f3b5a919fa45339fafffc36c108091 in term 1.
I20260808 10:00:39.975406 14083 leader_election.cc:302] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a005504faeac41e18a0bb4127d57a94e, f0f3b5a919fa45339fafffc36c108091; no voters:
I20260808 10:00:39.975523 14267 raft_consensus.cc:2781] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:00:39.975714 14267 raft_consensus.cc:686] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 LEADER]: Becoming Leader. State: Replica: f0f3b5a919fa45339fafffc36c108091, State: Running, Role: LEADER
I20260808 10:00:39.975775 14267 consensus_queue.cc:237] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:39.976553 13970 catalog_manager.cc:5495] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f3b5a919fa45339fafffc36c108091 (127.24.71.193). New cstate: current_term: 1 leader_uuid: "f0f3b5a919fa45339fafffc36c108091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } health_report { overall_health: HEALTHY } } }
W20260808 10:00:39.997074 14710 tablet.cc:2369] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:00:40.001947 14745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:39.999515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41912 (local address 127.24.71.193:33183)
0808 10:00:39.999638 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:39.999640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:39.999648 (+ 8us) server_negotiation.cc:407] Connection header received
0808 10:00:39.999685 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:39.999686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:39.999706 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:39.999777 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:00:39.999891 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:40.000379 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:40.001145 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:40.001349 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:40.001410 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:40.001640 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:00:40.001747 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:00:40.001803 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:40.001862 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 10:00:40.001881 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":65,"threads_started":1}
I20260808 10:00:40.003540 14392 raft_consensus.cc:1261] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b [term 1 FOLLOWER]: Refusing update from remote peer f0f3b5a919fa45339fafffc36c108091: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:00:40.003579 14627 raft_consensus.cc:1261] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e [term 1 FOLLOWER]: Refusing update from remote peer f0f3b5a919fa45339fafffc36c108091: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:00:40.003888 14267 consensus_queue.cc:1035] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:00:40.004077 14741 consensus_queue.cc:1035] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:00:40.006496 14746 mvcc.cc:205] Tried to move back new op lower bound from 7316206551051849728 to 7316206550941442048. Current Snapshot: MvccSnapshot[applied={T|T < 7316206551051849728}]
I20260808 10:00:40.006819 14747 mvcc.cc:205] Tried to move back new op lower bound from 7316206551051849728 to 7316206550941442048. Current Snapshot: MvccSnapshot[applied={T|T < 7316206551051849728}]
I20260808 10:00:40.007305 14750 mvcc.cc:205] Tried to move back new op lower bound from 7316206551051849728 to 7316206550941442048. Current Snapshot: MvccSnapshot[applied={T|T < 7316206551051849728}]
I20260808 10:00:40.009725 13968 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:36290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:00:40.009817 13968 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:36290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:00:40.010553 13968 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Sending DeleteTablet for 3 replicas of tablet 17c3155bdae647f8817ee4989775d706
I20260808 10:00:40.010897 14152 tablet_service.cc:1514] Processing DeleteTablet for tablet 17c3155bdae647f8817ee4989775d706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:40 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:41902
I20260808 10:00:40.010886 14596 tablet_service.cc:1514] Processing DeleteTablet for tablet 17c3155bdae647f8817ee4989775d706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:40 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:58424
I20260808 10:00:40.010910 14360 tablet_service.cc:1514] Processing DeleteTablet for tablet 17c3155bdae647f8817ee4989775d706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:40 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:59478
I20260808 10:00:40.011089 14763 tablet_replica.cc:330] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091: stopping tablet replica
I20260808 10:00:40.011148 14763 raft_consensus.cc:2229] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 LEADER]: Raft consensus shutting down.
I20260808 10:00:40.011231 14763 raft_consensus.cc:2258] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:00:40.011258 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 14026
I20260808 10:00:40.022229 14765 tablet_replica.cc:330] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e: stopping tablet replica
I20260808 10:00:40.022444 14765 raft_consensus.cc:2229] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:00:40.022605 14765 raft_consensus.cc:2258] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:00:40.022852 14767 tablet_replica.cc:330] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b: stopping tablet replica
I20260808 10:00:40.022975 14767 raft_consensus.cc:2229] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:00:40.023075 14767 raft_consensus.cc:2258] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:00:40.024087 14765 ts_tablet_manager.cc:1905] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:00:40.024259 14767 ts_tablet_manager.cc:1905] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:00:40.025918 14767 ts_tablet_manager.cc:1918] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:00:40.026027 14767 log.cc:1196] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/17c3155bdae647f8817ee4989775d706
I20260808 10:00:40.026221 14765 ts_tablet_manager.cc:1918] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:00:40.026310 14765 log.cc:1196] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/17c3155bdae647f8817ee4989775d706
I20260808 10:00:40.026340 14767 ts_tablet_manager.cc:1939] T 17c3155bdae647f8817ee4989775d706 P f3d092d6e46c45d8af8b81153a3f9e8b: Deleting consensus metadata
I20260808 10:00:40.026620 14765 ts_tablet_manager.cc:1939] T 17c3155bdae647f8817ee4989775d706 P a005504faeac41e18a0bb4127d57a94e: Deleting consensus metadata
I20260808 10:00:40.026860 13941 catalog_manager.cc:4841] TS f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719): tablet 17c3155bdae647f8817ee4989775d706 (table test-table [id=cf82aa7c9cf74d86a80c59b52c3adf04]) successfully deleted
I20260808 10:00:40.027108 13939 catalog_manager.cc:4841] TS a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047): tablet 17c3155bdae647f8817ee4989775d706 (table test-table [id=cf82aa7c9cf74d86a80c59b52c3adf04]) successfully deleted
W20260808 10:00:40.029659 13940 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:33183 (error 108)
I20260808 10:00:40.029803 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 14266
I20260808 10:00:40.036499 14268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:40.036317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:33183 (local address 127.0.0.1:41928)
0808 10:00:40.036387 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:40.036445 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:33183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 10:00:40.036703 13940 catalog_manager.cc:4584] TS f0f3b5a919fa45339fafffc36c108091 (127.24.71.193:33183): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 17c3155bdae647f8817ee4989775d706: Network error: Client connection negotiation failed: client connection to 127.24.71.193:33183: connect: Connection refused (error 111)
I20260808 10:00:40.042304 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 14481
I20260808 10:00:40.051352 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 13915
I20260808 10:00:40.061058 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33791
--webserver_interface=127.24.71.254
--webserver_port=39215
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:33791
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:40.144575 14770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:40.144788 14770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:40.144814 14770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:40.145961 14770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:00:40.146005 14770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:40.146020 14770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:40.146035 14770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:00:40.146049 14770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:00:40.147688 14770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:33791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=39215
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:40.147944 14770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:40.148182 14770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:40.153017 14785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:40.153013 14781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:40.153024 14782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:40.153446 14770 server_base.cc:1034] running on GCE node
I20260808 10:00:40.153700 14770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:40.153993 14770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:40.155184 14770 hybrid_clock.cc:648] HybridClock initialized: now 1786183240155177 us; error 36 us; skew 500 ppm
Aug 08 10:00:40 dist-test-slave-gw5c krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183240, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:40.157814 14770 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:00:40.158284 14770 webserver.cc:460] Webserver started at http://127.24.71.254:39215/ using document root <none> and password file <none>
I20260808 10:00:40.158480 14770 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:40.158522 14770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:40.159917 14770 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:00:40.160561 14799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:40.160743 14770 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 10:00:40.160830 14770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "b24c43f6247c4e989a8284b6a6df0076"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "237c05d3d4fa341a3d70d95236077ffa"
server_key_iv: "e2d92f851106c34bda3e4e1b97c23912"
server_key_version: "encryptionkey@0"
I20260808 10:00:40.161162 14770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:40.175849 14770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:40.177997 14770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:40.178115 14770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:40.182329 14770 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:33791
I20260808 10:00:40.182365 14882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:33791 every 8 connection(s)
I20260808 10:00:40.182785 14770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:00:40.184437 14884 sys_catalog.cc:263] Verifying existing consensus state
I20260808 10:00:40.185186 14884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Bootstrap starting.
I20260808 10:00:40.186667 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 14770
I20260808 10:00:40.186949 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:33183
--local_ip_for_outbound_sockets=127.24.71.193
--tserver_master_addrs=127.24.71.254:33791
--webserver_port=44991
--webserver_interface=127.24.71.193
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:00:40.195119 14884 log.cc:824] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:40.197436 14884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 10:00:40.197760 14884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076: Bootstrap complete.
I20260808 10:00:40.200239 14884 raft_consensus.cc:348] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } }
I20260808 10:00:40.200482 14884 raft_consensus.cc:729] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b24c43f6247c4e989a8284b6a6df0076, State: Initialized, Role: FOLLOWER
I20260808 10:00:40.200688 14884 consensus_queue.cc:260] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } }
I20260808 10:00:40.200788 14884 raft_consensus.cc:388] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:00:40.200843 14884 raft_consensus.cc:482] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:00:40.200897 14884 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 2 FOLLOWER]: Advancing to term 3
I20260808 10:00:40.201853 14884 raft_consensus.cc:504] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } }
I20260808 10:00:40.201979 14884 leader_election.cc:302] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b24c43f6247c4e989a8284b6a6df0076; no voters:
I20260808 10:00:40.202180 14884 leader_election.cc:288] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 10:00:40.202308 14889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 10:00:40.202481 14884 sys_catalog.cc:564] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:00:40.202502 14889 raft_consensus.cc:686] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [term 3 LEADER]: Becoming Leader. State: Replica: b24c43f6247c4e989a8284b6a6df0076, State: Running, Role: LEADER
I20260808 10:00:40.202723 14889 consensus_queue.cc:237] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } }
I20260808 10:00:40.203029 14890 sys_catalog.cc:455] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b24c43f6247c4e989a8284b6a6df0076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } } }
I20260808 10:00:40.203125 14890 sys_catalog.cc:458] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:40.203284 14891 sys_catalog.cc:455] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b24c43f6247c4e989a8284b6a6df0076. Latest consensus state: current_term: 3 leader_uuid: "b24c43f6247c4e989a8284b6a6df0076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c43f6247c4e989a8284b6a6df0076" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33791 } } }
I20260808 10:00:40.203344 14891 sys_catalog.cc:458] T 00000000000000000000000000000000 P b24c43f6247c4e989a8284b6a6df0076 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:40.203531 14902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:00:40.204317 14902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:00:40.204433 14902 catalog_manager.cc:1259] Loaded cluster ID: 64d3266fa06a40d1ab4fd8126c23cdde
I20260808 10:00:40.204459 14902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 10:00:40.204768 14902 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8663c2a9ad google::LogMessage::Fail() at ??:0
@ 0x7f8663c2d88a google::LogMessage::SendToLog() at ??:0
@ 0x7f8663c2a4de google::LogMessage::Flush() at ??:0
@ 0x7f8663c2ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f866bb4f0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f866bb588b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8665af80d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8665aed954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f86669516db start_thread at ??:0
@ 0x7f866272861f clone at ??:0
W20260808 10:00:40.288358 14886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:40.288561 14886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:40.288585 14886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:40.289811 14886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:40.289865 14886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:40.289893 14886 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:00:40.291446 14886 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:33183
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=44991
--tserver_master_addrs=127.24.71.254:33791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:40.291714 14886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:40.291975 14886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:40.297200 14944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:40.297298 14886 server_base.cc:1034] running on GCE node
W20260808 10:00:40.297192 14953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:40.297433 14945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:40.297683 14886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:40.297977 14886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:40.299165 14886 hybrid_clock.cc:648] HybridClock initialized: now 1786183240299151 us; error 29 us; skew 500 ppm
Aug 08 10:00:40 dist-test-slave-gw5c krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183240, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:40.302419 14886 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 10:00:40.303017 14886 webserver.cc:460] Webserver started at http://127.24.71.193:44991/ using document root <none> and password file <none>
I20260808 10:00:40.303313 14886 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:40.303409 14886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:40.305174 14886 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:00:40.305965 14961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:40.306169 14886 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:00:40.306272 14886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "f0f3b5a919fa45339fafffc36c108091"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "7064136d423efb6e5d8b22d516deda3e"
server_key_iv: "676cb399906dbd033002b37dd75bbcfb"
server_key_version: "encryptionkey@0"
I20260808 10:00:40.306746 14886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:40.318302 14886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:40.320999 14886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:40.321174 14886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:40.321458 14886 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:40.322014 14976 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 10:00:40.323673 14886 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 10:00:40.323745 14886 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 10:00:40.323783 14886 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 10:00:40.324688 14886 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 10:00:40.324745 14886 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 10:00:40.324828 14976 tablet_bootstrap.cc:492] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091: Bootstrap starting.
I20260808 10:00:40.332310 14886 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:33183
I20260808 10:00:40.332412 15155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:33183 every 8 connection(s)
I20260808 10:00:40.332808 14886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 10:00:40.334255 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 14886
I20260808 10:00:40.334575 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:36719
--local_ip_for_outbound_sockets=127.24.71.194
--tserver_master_addrs=127.24.71.254:33791
--webserver_port=39999
--webserver_interface=127.24.71.194
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:00:40.336761 14976 log.cc:824] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:40.339146 14976 tablet_bootstrap.cc:492] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 10:00:40.339504 14976 tablet_bootstrap.cc:492] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091: Bootstrap complete.
I20260808 10:00:40.340853 14976 ts_tablet_manager.cc:1397] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.005s
I20260808 10:00:40.342730 14976 raft_consensus.cc:348] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:40.343161 14976 raft_consensus.cc:729] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f3b5a919fa45339fafffc36c108091, State: Initialized, Role: FOLLOWER
I20260808 10:00:40.343358 14976 consensus_queue.cc:260] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:40.343706 14976 ts_tablet_manager.cc:1428] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
W20260808 10:00:40.409299 15159 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:00:40.333584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:56077)
0808 10:00:40.333822 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:40.333883 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:40.335074 (+ 1191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:40.409070 (+ 73996us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":111,"threads_started":1}
W20260808 10:00:40.409606 15157 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:33791 (0 consecutive failures): Network error: Failed to ping master at 127.24.71.254:33791: Client connection negotiation failed: client connection to 127.24.71.254:33791: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 10:00:40.410025 15159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:40.409877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:56963)
0808 10:00:40.409941 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:40.409996 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 10:00:40.410418 15159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:40.410296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:40537)
0808 10:00:40.410344 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:40.410375 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 10:00:40.410542 15157 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 10:00:40.425405 15160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:40.425617 15160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:40.425642 15160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:40.426815 15160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:40.426863 15160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:40.426890 15160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:00:40.428452 15160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:36719
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=39999
--tserver_master_addrs=127.24.71.254:33791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:40.428723 15160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:40.428984 15160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:40.434175 15172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:40.434299 15160 server_base.cc:1034] running on GCE node
W20260808 10:00:40.434167 15169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:40.434190 15170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:40.434597 15160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:40.434851 15160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:40.436018 15160 hybrid_clock.cc:648] HybridClock initialized: now 1786183240436007 us; error 40 us; skew 500 ppm
Aug 08 10:00:40 dist-test-slave-gw5c krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183240, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:40.438479 15160 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 10:00:40.438906 15160 webserver.cc:460] Webserver started at http://127.24.71.194:39999/ using document root <none> and password file <none>
I20260808 10:00:40.439145 15160 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:40.439217 15160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:40.440613 15160 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:00:40.441220 15182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:40.441404 15160 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:00:40.441531 15160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "f3d092d6e46c45d8af8b81153a3f9e8b"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "2c798ae9d0d371d345201da9f776250b"
server_key_iv: "0ccf4d6842b5d8de98e8426759c91594"
server_key_version: "encryptionkey@0"
I20260808 10:00:40.441918 15160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:40.454128 15160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:40.456233 15160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:40.456408 15160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:40.456664 15160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:40.456990 15160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:40.457044 15160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:40.457087 15160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:40.457129 15160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:40.463438 15160 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:36719
I20260808 10:00:40.463572 15385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:36719 every 8 connection(s)
I20260808 10:00:40.463915 15160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 10:00:40.465240 15392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:40.464647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:47731)
0808 10:00:40.464812 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:40.464891 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
W20260808 10:00:40.465483 15386 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:33791 (0 consecutive failures): Network error: Failed to ping master at 127.24.71.254:33791: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
I20260808 10:00:40.465762 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 15160
I20260808 10:00:40.465807 15392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:40.465691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:52251)
0808 10:00:40.465740 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:40.465768 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 10:00:40.466022 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:35047
--local_ip_for_outbound_sockets=127.24.71.195
--tserver_master_addrs=127.24.71.254:33791
--webserver_port=45265
--webserver_interface=127.24.71.195
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:34121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:00:40.466152 15392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:40.466062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:54499)
0808 10:00:40.466107 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:40.466130 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 10:00:40.466257 15386 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 10:00:40.550536 15394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:40.550774 15394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:40.550813 15394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:40.552001 15394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:40.552069 15394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:40.552112 15394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:00:40.553594 15394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:34121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:35047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=45265
--tserver_master_addrs=127.24.71.254:33791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:40.553865 15394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:40.554104 15394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:40.559347 15402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:40.559423 15405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:40.559422 15408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:40.559602 15394 server_base.cc:1034] running on GCE node
I20260808 10:00:40.559801 15394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:40.559998 15394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:40.561162 15394 hybrid_clock.cc:648] HybridClock initialized: now 1786183240561147 us; error 28 us; skew 500 ppm
Aug 08 10:00:40 dist-test-slave-gw5c krb5kdc[13006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183240, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:40.563687 15394 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 10:00:40.564072 15394 webserver.cc:460] Webserver started at http://127.24.71.195:45265/ using document root <none> and password file <none>
I20260808 10:00:40.564321 15394 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:40.564370 15394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:40.565727 15394 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:00:40.566423 15422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:40.566646 15394 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:00:40.566742 15394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "a005504faeac41e18a0bb4127d57a94e"
format_stamp: "Formatted at 2026-08-08 10:00:38 on dist-test-slave-gw5c"
server_key: "5f172c494e00e151ebe33a0fd58a0dae"
server_key_iv: "02f49df7b3000bd8ebbdf672b2705786"
server_key_version: "encryptionkey@0"
I20260808 10:00:40.567116 15394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:40.581697 15394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:40.584281 15394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:40.584453 15394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:40.584729 15394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:40.585093 15394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:40.585151 15394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:40.585186 15394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:40.585214 15394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:40.591473 15394 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:35047
I20260808 10:00:40.591513 15617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:35047 every 8 connection(s)
I20260808 10:00:40.591897 15394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 10:00:40.593034 15620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:40.592636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:58911)
0808 10:00:40.592800 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:40.592883 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":71,"threads_started":1}
W20260808 10:00:40.593468 15618 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:33791 (0 consecutive failures): Network error: Failed to ping master at 127.24.71.254:33791: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
I20260808 10:00:40.593752 15620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:40.593651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:37337)
0808 10:00:40.593695 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:40.593723 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 10:00:40.593993 15620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:40.593943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:58525)
0808 10:00:40.593963 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:40.593981 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260808 10:00:40.594102 15618 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 10:00:40.602108 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 15394
I20260808 10:00:41.411360 15622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:41.411065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:53495)
0808 10:00:41.411226 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:41.411273 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":68,"threads_started":1}
I20260808 10:00:41.466786 15623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:41.466563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:53851)
0808 10:00:41.466693 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:41.466731 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":58,"threads_started":1}
I20260808 10:00:41.594707 15624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:41.594498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:58157)
0808 10:00:41.594628 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:41.594663 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
I20260808 10:00:42.205222 15625 raft_consensus.cc:482] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:00:42.205427 15625 raft_consensus.cc:504] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:42.205865 15625 leader_election.cc:288] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047), f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719)
Aug 08 10:00:42 dist-test-slave-gw5c krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183240, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.195@KRBTEST.COM
Aug 08 10:00:42 dist-test-slave-gw5c krb5kdc[13006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183240, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.194@KRBTEST.COM
I20260808 10:00:42.217185 15628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:42.206083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:36719 (local address 127.24.71.193:55825)
0808 10:00:42.206215 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:42.206227 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:42.206286 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:42.207099 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:42.207102 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:42.207560 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:42.207760 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:42.207766 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:42.208884 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:42.208885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:42.209641 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:42.209644 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:42.210274 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:42.210275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:42.210396 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:42.211003 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:42.211011 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:42.213141 (+ 2130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:42.215512 (+ 2371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:42.215513 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:42.215514 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:42.215735 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:42.215999 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:42.216000 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:42.216000 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:42.216066 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:42.216528 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:42.216539 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:42.216705 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 10:00:42.216839 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 10:00:42.217060 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":72,"thread_start_us":67,"threads_started":1}
I20260808 10:00:42.217206 15634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:42.206163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:37331 (local address 127.24.71.195:35047)
0808 10:00:42.206380 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:42.206391 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:42.206414 (+ 23us) server_negotiation.cc:407] Connection header received
0808 10:00:42.206856 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:42.206858 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:42.206910 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:42.207068 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:42.207897 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:42.208752 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:42.209745 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:42.210149 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:42.210280 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:42.212781 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:42.212786 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:42.212786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:42.212799 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:42.215063 (+ 2264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:42.215672 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:42.215675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:42.215675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:42.215791 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:42.216085 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:42.216086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:42.216086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:42.216440 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:42.216535 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:42.216938 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 10:00:42.217077 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":59,"threads_started":1}
I20260808 10:00:42.217206 15636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:42.206190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:55825 (local address 127.24.71.194:36719)
0808 10:00:42.206402 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:42.206411 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:42.206430 (+ 19us) server_negotiation.cc:407] Connection header received
0808 10:00:42.206856 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:42.206858 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:42.206899 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:42.207037 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:42.207894 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:42.208762 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:42.209748 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:42.210167 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:42.210289 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:42.213247 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:42.213250 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:42.213251 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:42.213261 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:42.215356 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:42.215812 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:42.215815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:42.215815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:42.215924 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:42.216133 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:42.216134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:42.216135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:42.216448 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:42.216535 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:42.216926 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 10:00:42.217076 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":53,"threads_started":1}
I20260808 10:00:42.217259 15631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:42.206049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:35047 (local address 127.24.71.193:37331)
0808 10:00:42.206190 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:42.206203 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:42.206278 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:42.207100 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:42.207103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:42.207559 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:42.207760 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:42.207766 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:42.208859 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:42.208860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:42.209640 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:42.209643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:42.210303 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:42.210304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:42.210396 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:42.211059 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:42.211064 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:42.212623 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:42.215167 (+ 2544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:42.215174 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:42.215176 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:42.215585 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:42.215869 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:42.215869 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:42.215869 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:42.216005 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:42.216528 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:42.216539 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:42.216705 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 10:00:42.216835 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 10:00:42.217116 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":141,"thread_start_us":76,"threads_started":1}
W20260808 10:00:42.218508 14963 leader_election.cc:341] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047): Not found: Tablet not found: 17c3155bdae647f8817ee4989775d706
W20260808 10:00:42.218608 14970 leader_election.cc:341] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719): Not found: Tablet not found: 17c3155bdae647f8817ee4989775d706
I20260808 10:00:42.218711 14970 leader_election.cc:302] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f3b5a919fa45339fafffc36c108091; no voters: a005504faeac41e18a0bb4127d57a94e, f3d092d6e46c45d8af8b81153a3f9e8b
I20260808 10:00:42.218880 15625 raft_consensus.cc:2726] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 10:00:42.412147 15631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:42.411999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:52683)
0808 10:00:42.412056 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:42.412104 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 10:00:42.467603 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:42.467275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:58411)
0808 10:00:42.467501 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:42.467551 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":68,"threads_started":1}
I20260808 10:00:42.595412 15641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:42.595161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:35783)
0808 10:00:42.595296 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:42.595339 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260808 10:00:43.412955 15642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:43.412705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:42365)
0808 10:00:43.412857 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:43.412903 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260808 10:00:43.468292 15643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:43.468083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:51713)
0808 10:00:43.468208 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:43.468242 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":62,"threads_started":1}
I20260808 10:00:43.596184 15645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:43.595924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:35753)
0808 10:00:43.596084 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:43.596136 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":64,"threads_started":1}
I20260808 10:00:44.162587 15647 raft_consensus.cc:482] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:00:44.162722 15647 raft_consensus.cc:504] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:44.162958 15647 leader_election.cc:288] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047), f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719)
W20260808 10:00:44.163479 14963 leader_election.cc:341] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047): Not found: Tablet not found: 17c3155bdae647f8817ee4989775d706
W20260808 10:00:44.163568 14970 leader_election.cc:341] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719): Not found: Tablet not found: 17c3155bdae647f8817ee4989775d706
I20260808 10:00:44.163664 14970 leader_election.cc:302] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f3b5a919fa45339fafffc36c108091; no voters: a005504faeac41e18a0bb4127d57a94e, f3d092d6e46c45d8af8b81153a3f9e8b
I20260808 10:00:44.163760 15647 raft_consensus.cc:2726] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 10:00:44.413759 15648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:44.413501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:46377)
0808 10:00:44.413636 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:44.413680 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":71,"threads_started":1}
I20260808 10:00:44.469081 15650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:44.468811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:44927)
0808 10:00:44.468967 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:44.469017 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":70,"threads_started":1}
I20260808 10:00:44.597074 15651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:44.596794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:54407)
0808 10:00:44.596966 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:44.597011 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":84,"threads_started":1}
I20260808 10:00:45.414691 15658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:45.414434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:52349)
0808 10:00:45.414586 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:45.414640 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":72,"threads_started":1}
I20260808 10:00:45.470074 15659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:45.469835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:55961)
0808 10:00:45.469980 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:45.470024 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
I20260808 10:00:45.597888 15660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:45.597626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:34125)
0808 10:00:45.597798 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:45.597840 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":88,"threads_started":1}
I20260808 10:00:45.850484 15662 raft_consensus.cc:482] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:00:45.850592 15662 raft_consensus.cc:504] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:45.850848 15662 leader_election.cc:288] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047), f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719)
W20260808 10:00:45.851430 14970 leader_election.cc:341] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719): Not found: Tablet not found: 17c3155bdae647f8817ee4989775d706
W20260808 10:00:45.851522 14963 leader_election.cc:341] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047): Not found: Tablet not found: 17c3155bdae647f8817ee4989775d706
I20260808 10:00:45.851558 14963 leader_election.cc:302] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f3b5a919fa45339fafffc36c108091; no voters: a005504faeac41e18a0bb4127d57a94e, f3d092d6e46c45d8af8b81153a3f9e8b
I20260808 10:00:45.851643 15662 raft_consensus.cc:2726] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 10:00:46.415660 15663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:46.415387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:48975)
0808 10:00:46.415566 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:46.415611 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":107,"threads_started":1}
I20260808 10:00:46.470834 15664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:46.470574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:45853)
0808 10:00:46.470737 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:46.470782 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":82,"threads_started":1}
I20260808 10:00:46.598656 15665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:46.598428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:45479)
0808 10:00:46.598571 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:46.598610 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":63,"threads_started":1}
I20260808 10:00:47.416445 15667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:47.416171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:39281)
0808 10:00:47.416343 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:47.416390 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":71,"threads_started":1}
I20260808 10:00:47.471628 15668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:47.471328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:54043)
0808 10:00:47.471536 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:47.471581 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":137,"threads_started":1}
I20260808 10:00:47.599490 15669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:47.599184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:43693)
0808 10:00:47.599343 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:47.599384 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":105,"threads_started":1}
I20260808 10:00:48.417301 15670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:48.417038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:50999)
0808 10:00:48.417195 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:48.417241 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":69,"threads_started":1}
I20260808 10:00:48.472486 15671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:48.472176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:39945)
0808 10:00:48.472377 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:48.472425 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":87,"threads_started":1}
I20260808 10:00:48.600145 15672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:48.599935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:45661)
0808 10:00:48.600060 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:48.600097 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260808 10:00:49.418203 15678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:49.417947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:34875)
0808 10:00:49.418107 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:49.418154 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":100,"threads_started":1}
I20260808 10:00:49.473261 15679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:49.473013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:57217)
0808 10:00:49.473171 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:49.473210 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":70,"threads_started":1}
I20260808 10:00:49.571511 15680 raft_consensus.cc:482] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:00:49.571614 15680 raft_consensus.cc:504] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005504faeac41e18a0bb4127d57a94e" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35047 } } peers { permanent_uuid: "f3d092d6e46c45d8af8b81153a3f9e8b" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 36719 } } peers { permanent_uuid: "f0f3b5a919fa45339fafffc36c108091" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33183 } }
I20260808 10:00:49.571864 15680 leader_election.cc:288] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047), f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719)
W20260808 10:00:49.572268 14970 leader_election.cc:341] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f3d092d6e46c45d8af8b81153a3f9e8b (127.24.71.194:36719): Not found: Tablet not found: 17c3155bdae647f8817ee4989775d706
W20260808 10:00:49.572358 14963 leader_election.cc:341] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a005504faeac41e18a0bb4127d57a94e (127.24.71.195:35047): Not found: Tablet not found: 17c3155bdae647f8817ee4989775d706
I20260808 10:00:49.572463 14963 leader_election.cc:302] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f3b5a919fa45339fafffc36c108091; no voters: a005504faeac41e18a0bb4127d57a94e, f3d092d6e46c45d8af8b81153a3f9e8b
I20260808 10:00:49.572577 15680 raft_consensus.cc:2726] T 17c3155bdae647f8817ee4989775d706 P f0f3b5a919fa45339fafffc36c108091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 10:00:49.600948 15681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:49.600718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:39459)
0808 10:00:49.600858 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:49.600900 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":91,"threads_started":1}
I20260808 10:00:50.419102 15682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:50.418807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:53033)
0808 10:00:50.418996 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:50.419051 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":70,"threads_started":1}
I20260808 10:00:50.474139 15684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:50.473883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:54557)
0808 10:00:50.474041 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:50.474090 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":72,"threads_started":1}
I20260808 10:00:50.601704 15685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:50.601474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:40671)
0808 10:00:50.601615 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:50.601656 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
I20260808 10:00:51.419975 15688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:51.419716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:41427)
0808 10:00:51.419867 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:51.419919 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":71,"threads_started":1}
I20260808 10:00:51.474926 15689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:51.474689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:55689)
0808 10:00:51.474834 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:51.474876 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":74,"threads_started":1}
I20260808 10:00:51.602440 15693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:51.602183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:47635)
0808 10:00:51.602341 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:51.602382 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":66,"threads_started":1}
I20260808 10:00:52.420796 15694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:52.420569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:40977)
0808 10:00:52.420699 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:52.420746 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":67,"threads_started":1}
I20260808 10:00:52.475901 15695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:52.475608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:35845)
0808 10:00:52.475806 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:52.475851 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":77,"threads_started":1}
I20260808 10:00:52.603262 15697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:52.603030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:57015)
0808 10:00:52.603162 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:52.603204 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":66,"threads_started":1}
I20260808 10:00:53.421694 15698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:53.421384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:48943)
0808 10:00:53.421573 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:53.421640 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":71,"threads_started":1}
I20260808 10:00:53.476742 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:53.476485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:39567)
0808 10:00:53.476636 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:53.476682 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":97,"threads_started":1}
I20260808 10:00:53.603986 15704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:53.603763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:49927)
0808 10:00:53.603907 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:53.603939 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":85,"threads_started":1}
I20260808 10:00:54.422541 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:54.422312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:49977)
0808 10:00:54.422453 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:54.422492 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
I20260808 10:00:54.477521 15711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:54.477268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:43881)
0808 10:00:54.477426 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:54.477471 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":71,"threads_started":1}
I20260808 10:00:54.604761 15712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:54.604485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:53669)
0808 10:00:54.604650 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:54.604695 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":67,"threads_started":1}
I20260808 10:00:55.423503 15714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:55.423219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.193:38601)
0808 10:00:55.423380 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:55.423453 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":71,"threads_started":1}
I20260808 10:00:55.478325 15715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:55.478081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.194:51255)
0808 10:00:55.478207 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:55.478271 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260808 10:00:55.604777 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 14886
I20260808 10:00:55.614952 15718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:55.613033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33791 (local address 127.24.71.195:58701)
0808 10:00:55.614846 (+ 1813us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:55.614888 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1792,"thread_start_us":945,"threads_started":1}
I20260808 10:00:55.623581 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 15160
I20260808 10:00:55.639662 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 15394
2026-08-08T10:00:55Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18751 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:00:55 dist-test-slave-gw5c krb5kdc[15723](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:00:55 dist-test-slave-gw5c krb5kdc[15723](info): set up 2 sockets
Aug 08 10:00:55 dist-test-slave-gw5c krb5kdc[15723](info): commencing operation
krb5kdc: starting...
W20260808 10:00:56.891876 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:00:56 dist-test-slave-gw5c krb5kdc[15723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183256, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:00:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:00:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:00:57.022779 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:35717
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:35717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:57.107070 15747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:57.107292 15747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:57.107316 15747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:57.108497 15747 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 10:00:57.108541 15747 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 10:00:57.108554 15747 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 10:00:57.108566 15747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:00:57.108578 15747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:57.108592 15747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:57.108604 15747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:00:57.108623 15747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:00:57.110020 15747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:35717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:35717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:57.110214 15747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:57.110395 15747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:57.115528 15757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:57.115594 15756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:57.115578 15747 server_base.cc:1034] running on GCE node
W20260808 10:00:57.115643 15760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:57.116034 15747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:57.116382 15747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:57.117551 15747 hybrid_clock.cc:648] HybridClock initialized: now 1786183257117529 us; error 36 us; skew 500 ppm
Aug 08 10:00:57 dist-test-slave-gw5c krb5kdc[15723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183257, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:57.120347 15747 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:00:57.120841 15747 webserver.cc:460] Webserver started at http://127.24.71.254:37709/ using document root <none> and password file <none>
I20260808 10:00:57.121074 15747 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:57.121142 15747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:57.121304 15747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:00:57.122388 15747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "3d46b6deac354c6d9b099aa764eca348"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "b4bd68b6488286758200d3d35f2b55e2"
server_key_iv: "e4ea452808db83a4c360395c940fdd79"
server_key_version: "encryptionkey@0"
I20260808 10:00:57.122761 15747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "3d46b6deac354c6d9b099aa764eca348"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "b4bd68b6488286758200d3d35f2b55e2"
server_key_iv: "e4ea452808db83a4c360395c940fdd79"
server_key_version: "encryptionkey@0"
I20260808 10:00:57.124293 15747 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 10:00:57.125083 15770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:57.125392 15747 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:00:57.125531 15747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "3d46b6deac354c6d9b099aa764eca348"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "b4bd68b6488286758200d3d35f2b55e2"
server_key_iv: "e4ea452808db83a4c360395c940fdd79"
server_key_version: "encryptionkey@0"
I20260808 10:00:57.125619 15747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:57.140558 15747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:57.142830 15747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:57.143018 15747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:57.147537 15747 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:35717
I20260808 10:00:57.147580 15850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:35717 every 8 connection(s)
I20260808 10:00:57.147962 15747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:00:57.148787 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 15747
I20260808 10:00:57.148901 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:00:57.149075 15852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:57.149149 24863 external_mini_cluster.cc:1428] Setting key 9e97429c62a8ac5fa82af9f975017fc8
I20260808 10:00:57.152367 15852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Bootstrap starting.
I20260808 10:00:57.153039 15852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:57.153379 15852 log.cc:824] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:57.154129 15852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: No bootstrap required, opened a new log
Aug 08 10:00:57 dist-test-slave-gw5c krb5kdc[15723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183256, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:57.156524 15852 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } }
I20260808 10:00:57.156716 15852 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:57.156778 15852 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d46b6deac354c6d9b099aa764eca348, State: Initialized, Role: FOLLOWER
I20260808 10:00:57.156935 15852 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } }
I20260808 10:00:57.157066 15852 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:00:57.157107 15852 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:00:57.157171 15852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:57.157994 15852 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } }
I20260808 10:00:57.158118 15852 leader_election.cc:302] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d46b6deac354c6d9b099aa764eca348; no voters:
I20260808 10:00:57.158294 15852 leader_election.cc:288] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:00:57.158376 15859 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:00:57.158586 15859 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 1 LEADER]: Becoming Leader. State: Replica: 3d46b6deac354c6d9b099aa764eca348, State: Running, Role: LEADER
I20260808 10:00:57.158591 15852 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:00:57.158704 15859 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } }
I20260808 10:00:57.159119 15860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d46b6deac354c6d9b099aa764eca348" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } } }
I20260808 10:00:57.159107 15859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d46b6deac354c6d9b099aa764eca348. Latest consensus state: current_term: 1 leader_uuid: "3d46b6deac354c6d9b099aa764eca348" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } } }
I20260808 10:00:57.159271 15860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:57.159278 15859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: This master's current role is: LEADER
I20260808 10:00:57.159626 15873 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:00:57.160461 15873 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:00:57.160852 15856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.149715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45338 (local address 127.24.71.254:35717)
0808 10:00:57.149935 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:57.149942 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:57.149969 (+ 27us) server_negotiation.cc:407] Connection header received
0808 10:00:57.150362 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:57.150368 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:57.150413 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:57.150560 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:57.151214 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.152150 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.153016 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.153531 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.153651 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.156425 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:57.156429 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:57.156430 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:57.156448 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:57.158687 (+ 2239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:57.159243 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:57.159246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:57.159246 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:57.159383 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:57.159695 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:57.159696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:57.159697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:57.160088 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:57.160281 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:57.160438 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 10:00:57.160616 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":108,"threads_started":1}
I20260808 10:00:57.162240 15873 catalog_manager.cc:1347] Generated new cluster ID: 9eb5b474bb36487db049a8c7b80d4e75
I20260808 10:00:57.162336 15873 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:00:57.169310 15873 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:00:57.169907 15873 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:00:57.178781 15873 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Generated new TSK 0
I20260808 10:00:57.179044 15873 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 10:00:57.212400 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35717
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:57.297816 15898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:57.298026 15898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:57.298053 15898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:57.299209 15898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:57.299249 15898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:57.299275 15898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:00:57.300768 15898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:57.300962 15898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:57.301147 15898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:57.306282 15914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:57.306325 15918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:57.306383 15912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:57.306655 15898 server_base.cc:1034] running on GCE node
I20260808 10:00:57.306931 15898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:57.307210 15898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:57.308432 15898 hybrid_clock.cc:648] HybridClock initialized: now 1786183257308418 us; error 47 us; skew 500 ppm
Aug 08 10:00:57 dist-test-slave-gw5c krb5kdc[15723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183257, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:57.311312 15898 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 10:00:57.311955 15898 webserver.cc:460] Webserver started at http://127.24.71.193:43379/ using document root <none> and password file <none>
I20260808 10:00:57.312294 15898 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:57.312386 15898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:57.312551 15898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:00:57.313727 15898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "dd2aed0446a24f8ab297fac5759612c9"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "7b99934e331a335368b34a3cf6467dfd"
server_key_iv: "045737c38e93f21ea47f353268155d73"
server_key_version: "encryptionkey@0"
I20260808 10:00:57.314138 15898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "dd2aed0446a24f8ab297fac5759612c9"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "7b99934e331a335368b34a3cf6467dfd"
server_key_iv: "045737c38e93f21ea47f353268155d73"
server_key_version: "encryptionkey@0"
I20260808 10:00:57.315742 15898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260808 10:00:57.316624 15926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:57.316833 15898 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:00:57.316944 15898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "dd2aed0446a24f8ab297fac5759612c9"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "7b99934e331a335368b34a3cf6467dfd"
server_key_iv: "045737c38e93f21ea47f353268155d73"
server_key_version: "encryptionkey@0"
I20260808 10:00:57.317027 15898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:57.331864 15898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:57.334142 15898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:57.334342 15898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:57.334613 15898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:57.334956 15898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:57.335013 15898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:57.335050 15898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:57.335099 15898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:57.341661 15898 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:42975
I20260808 10:00:57.341718 16117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:42975 every 8 connection(s)
I20260808 10:00:57.342061 15898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 10:00:57.348556 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 15898
I20260808 10:00:57.348645 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
Aug 08 10:00:57 dist-test-slave-gw5c krb5kdc[15723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183257, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:57.348889 24863 external_mini_cluster.cc:1428] Setting key 51b3b9641930197942996016dc6c57d7
I20260808 10:00:57.352454 15856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.342852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:35619 (local address 127.24.71.254:35717)
0808 10:00:57.342921 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:57.342923 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:57.343164 (+ 241us) server_negotiation.cc:407] Connection header received
0808 10:00:57.343787 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:57.343788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:57.343802 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:57.343870 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:57.344884 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.345407 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.346426 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.346657 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.346747 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.349301 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:57.349302 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:57.349302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:57.349310 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:57.350695 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:57.351225 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:57.351226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:57.351227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:57.351370 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:57.351693 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:57.351695 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:57.351695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:57.351859 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:57.351938 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:57.352216 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 10:00:57.352342 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 10:00:57.352489 16125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.342819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:35619)
0808 10:00:57.343031 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:57.343070 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:57.343676 (+ 606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:57.343958 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:57.343961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:57.344565 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:57.344769 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.344774 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.345525 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.345526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.346320 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.346322 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.346762 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.346763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.346898 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.347487 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:57.347498 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:57.349180 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:57.350777 (+ 1597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:57.350785 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:57.350788 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:57.351125 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:57.351474 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:57.351475 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:57.351475 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:57.351620 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:57.351936 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:57.351943 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:57.352069 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 10:00:57.352168 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 10:00:57.352300 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":128,"threads_started":1}
I20260808 10:00:57.353039 16121 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35717
I20260808 10:00:57.353152 16121 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:57.353365 16121 heartbeater.cc:511] Master 127.24.71.254:35717 requested a full tablet report, sending...
I20260808 10:00:57.353971 15795 ts_manager.cc:194] Registered new tserver with Master: dd2aed0446a24f8ab297fac5759612c9 (127.24.71.193:42975)
I20260808 10:00:57.354983 15795 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:35619
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 10:00:57.377959 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35717
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:57.462561 16128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:57.462774 16128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:57.462797 16128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:57.463915 16128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:57.463953 16128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:57.463977 16128 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:00:57.465400 16128 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:57.465600 16128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:57.465791 16128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:57.470929 16134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:57.470981 16135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:57.470944 16137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:57.471184 16128 server_base.cc:1034] running on GCE node
I20260808 10:00:57.471439 16128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:57.471707 16128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:57.472859 16128 hybrid_clock.cc:648] HybridClock initialized: now 1786183257472852 us; error 62 us; skew 500 ppm
Aug 08 10:00:57 dist-test-slave-gw5c krb5kdc[15723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183257, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:57.475637 16128 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 10:00:57.476120 16128 webserver.cc:460] Webserver started at http://127.24.71.194:46413/ using document root <none> and password file <none>
I20260808 10:00:57.476373 16128 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:57.476423 16128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:57.476557 16128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:00:57.477694 16128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "4e24c931395a497bba05a3d72e24c5fb"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "c08d5d65ec6b70a729cf3c16e30bbfa7"
server_key_iv: "dbf30b39a914d38e04604a36e43c6556"
server_key_version: "encryptionkey@0"
I20260808 10:00:57.478070 16128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "4e24c931395a497bba05a3d72e24c5fb"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "c08d5d65ec6b70a729cf3c16e30bbfa7"
server_key_iv: "dbf30b39a914d38e04604a36e43c6556"
server_key_version: "encryptionkey@0"
I20260808 10:00:57.479669 16128 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:00:57.480562 16156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:57.480758 16128 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:00:57.480871 16128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "4e24c931395a497bba05a3d72e24c5fb"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "c08d5d65ec6b70a729cf3c16e30bbfa7"
server_key_iv: "dbf30b39a914d38e04604a36e43c6556"
server_key_version: "encryptionkey@0"
I20260808 10:00:57.480963 16128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:57.491199 16128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:57.493393 16128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:57.493595 16128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:57.493867 16128 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:57.494199 16128 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:57.494252 16128 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:57.494288 16128 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:57.494330 16128 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:57.500664 16128 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:41907
I20260808 10:00:57.500792 16356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:41907 every 8 connection(s)
I20260808 10:00:57.501102 16128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 10:00:57.503989 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 16128
I20260808 10:00:57.504096 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 10:00:57.504307 24863 external_mini_cluster.cc:1428] Setting key eaa7774fc6415a8d03e5163cc921958d
Aug 08 10:00:57 dist-test-slave-gw5c krb5kdc[15723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183257, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:57.511636 15856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.501976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:50223 (local address 127.24.71.254:35717)
0808 10:00:57.502061 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:57.502063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:57.502211 (+ 148us) server_negotiation.cc:407] Connection header received
0808 10:00:57.502705 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:57.502706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:57.502717 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:57.502796 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:57.503920 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.504698 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.505829 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.506143 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.506227 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.508775 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:57.508777 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:57.508777 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:57.508785 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:57.510225 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:57.510634 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:57.510635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:57.510636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:57.510696 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:57.510955 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:57.510956 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:57.510956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:57.511073 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:57.511146 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:57.511458 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 10:00:57.511543 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 10:00:57.511844 16360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.501888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:50223)
0808 10:00:57.502064 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:57.502110 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:57.502610 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:57.502853 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:57.502857 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:57.503525 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:57.503731 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.503736 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.504805 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.504806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.505727 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.505730 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.506243 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.506244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.506360 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.506952 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:57.506960 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:57.508653 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:57.510322 (+ 1669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:57.510330 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:57.510332 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:57.510558 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:57.510772 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:57.510773 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:57.510773 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:57.510885 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:57.511152 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:57.511159 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:57.511303 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 10:00:57.511430 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 10:00:57.511595 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
I20260808 10:00:57.512497 16357 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35717
I20260808 10:00:57.512586 16357 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:57.512794 16357 heartbeater.cc:511] Master 127.24.71.254:35717 requested a full tablet report, sending...
I20260808 10:00:57.513211 15795 ts_manager.cc:194] Registered new tserver with Master: 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907)
I20260808 10:00:57.513774 15795 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:50223
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 10:00:57.532691 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35717
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:00:57.617262 16364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:00:57.617498 16364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:00:57.617524 16364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:00:57.618727 16364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:00:57.618778 16364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:00:57.618805 16364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:00:57.620456 16364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:00:57.620695 16364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:00:57.620908 16364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:00:57.626307 16372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:57.626281 16376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:00:57.626287 16371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:00:57.626380 16364 server_base.cc:1034] running on GCE node
I20260808 10:00:57.626643 16364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:00:57.626909 16364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:00:57.628098 16364 hybrid_clock.cc:648] HybridClock initialized: now 1786183257628074 us; error 44 us; skew 500 ppm
Aug 08 10:00:57 dist-test-slave-gw5c krb5kdc[15723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183257, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:00:57.630945 16364 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 10:00:57.631547 16364 webserver.cc:460] Webserver started at http://127.24.71.195:33861/ using document root <none> and password file <none>
I20260808 10:00:57.631788 16364 fs_manager.cc:359] Metadata directory not provided
I20260808 10:00:57.631834 16364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:00:57.631986 16364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:00:57.633095 16364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "d9cff9effdf84ccd97f443e8f29e3659"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "e65c8d41ad12b584b5cbc76d4592ee91"
server_key_iv: "a453c70af5412126993ff43809616795"
server_key_version: "encryptionkey@0"
I20260808 10:00:57.633495 16364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "d9cff9effdf84ccd97f443e8f29e3659"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "e65c8d41ad12b584b5cbc76d4592ee91"
server_key_iv: "a453c70af5412126993ff43809616795"
server_key_version: "encryptionkey@0"
I20260808 10:00:57.634852 16364 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:00:57.635695 16391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:57.636003 16364 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:00:57.636113 16364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "d9cff9effdf84ccd97f443e8f29e3659"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "e65c8d41ad12b584b5cbc76d4592ee91"
server_key_iv: "a453c70af5412126993ff43809616795"
server_key_version: "encryptionkey@0"
I20260808 10:00:57.636189 16364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:00:57.650817 16364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:00:57.653553 16364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:00:57.653779 16364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:00:57.654066 16364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:00:57.654425 16364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:00:57.654484 16364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:57.654531 16364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:00:57.654554 16364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:00:57.661577 16364 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:33367
I20260808 10:00:57.661629 16599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:33367 every 8 connection(s)
I20260808 10:00:57.661985 16364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
Aug 08 10:00:57 dist-test-slave-gw5c krb5kdc[15723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183257, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:00:57.668812 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 16364
I20260808 10:00:57.668885 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 10:00:57.669091 24863 external_mini_cluster.cc:1428] Setting key cc76a76b87389fae9fe1ed476fb8c4bb
I20260808 10:00:57.672072 15856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.662748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:54577 (local address 127.24.71.254:35717)
0808 10:00:57.662830 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:57.662833 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:57.663060 (+ 227us) server_negotiation.cc:407] Connection header received
0808 10:00:57.663711 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:57.663713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:57.663724 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:57.663780 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:57.664772 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.665307 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.666323 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.666519 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.666582 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.669073 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:57.669075 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:57.669075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:57.669084 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:57.670618 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:57.671041 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:57.671042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:57.671043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:57.671095 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:57.671375 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:57.671377 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:57.671377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:57.671574 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:57.671639 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:57.671930 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 10:00:57.672004 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 10:00:57.672381 16605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.662727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:54577)
0808 10:00:57.662932 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:57.662972 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:57.663569 (+ 597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:57.663848 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:57.663851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:57.664451 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:00:57.664658 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.664663 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.665425 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.665426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.666222 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.666223 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.666592 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.666593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.666696 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.667194 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:00:57.667203 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:00:57.668973 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:00:57.670702 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:57.670711 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:57.670712 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:57.670968 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:57.671141 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:00:57.671142 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:00:57.671142 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:00:57.671293 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:00:57.671649 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:00:57.671656 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:00:57.671800 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 10:00:57.671902 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 10:00:57.672046 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":114,"threads_started":1}
I20260808 10:00:57.673053 16603 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35717
I20260808 10:00:57.673152 16603 heartbeater.cc:464] Registering TS with master...
I20260808 10:00:57.673426 16603 heartbeater.cc:511] Master 127.24.71.254:35717 requested a full tablet report, sending...
I20260808 10:00:57.673882 15795 ts_manager.cc:194] Registered new tserver with Master: d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367)
I20260808 10:00:57.674278 15795 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:54577
I20260808 10:00:57.681107 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 10:00:57.689080 15856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.682601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45352 (local address 127.24.71.254:35717)
0808 10:00:57.682646 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:57.682649 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:57.682812 (+ 163us) server_negotiation.cc:407] Connection header received
0808 10:00:57.682843 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:57.682844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:57.682856 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:57.682925 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:00:57.683591 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.684170 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.684866 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.685078 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.685146 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.686410 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:00:57.686412 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:00:57.686412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:00:57.686419 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:00:57.687983 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:57.688336 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:57.688337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:57.688337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:57.688419 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:00:57.688597 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:00:57.688598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:00:57.688598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:00:57.688751 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:00:57.688827 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:57.688913 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 10:00:57.688977 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 10:00:57.690902 15795 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45352:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 10:00:57.692667 15795 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 10:00:57.699460 16625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.695104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:41907 (local address 127.0.0.1:46598)
0808 10:00:57.695598 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:57.695607 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:57.695694 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:57.696074 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:57.696075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:57.696077 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:57.696136 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.696139 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.697034 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.697035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.698311 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.698313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.699067 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.699068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.699158 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.699172 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 10:00:57.699280 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 10:00:57.699335 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"mutex_wait_us":2,"thread_start_us":47,"threads_started":1}
I20260808 10:00:57.699615 16627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.695316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46598 (local address 127.24.71.194:41907)
0808 10:00:57.695536 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:57.695541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:57.695687 (+ 146us) server_negotiation.cc:407] Connection header received
0808 10:00:57.695791 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:57.695794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:57.695817 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:57.695997 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:57.696219 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.696924 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.698406 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.698951 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.699064 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.699129 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:57.699462 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 10:00:57.699514 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":106,"threads_started":1}
I20260808 10:00:57.699590 16623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.695104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:33367 (local address 127.0.0.1:43978)
0808 10:00:57.695275 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:57.695316 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:57.695383 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:57.695803 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:57.695807 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:57.695809 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:57.695881 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.695882 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.697315 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.697316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.698368 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.698371 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.699295 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.699296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.699362 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.699368 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 10:00:57.699430 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 10:00:57.699471 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":3,"thread_start_us":108,"threads_started":1}
I20260808 10:00:57.699860 16628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.695315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43978 (local address 127.24.71.195:33367)
0808 10:00:57.695569 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:57.695574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:57.695585 (+ 11us) server_negotiation.cc:407] Connection header received
0808 10:00:57.695627 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:57.695629 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:57.695644 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:57.695988 (+ 344us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:57.696078 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.697196 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.698458 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.699193 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.699542 (+ 349us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.699607 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:57.699635 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 10:00:57.699738 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":132,"threads_started":1}
I20260808 10:00:57.699851 16624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.695119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:42975 (local address 127.0.0.1:58128)
0808 10:00:57.695791 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:57.695800 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:57.695846 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:57.696119 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:57.696120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:57.696121 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:57.696159 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.696160 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.697448 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.697449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.698408 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.698410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.699306 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.699307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.699359 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.699363 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:00:57.699721 (+ 358us) client_negotiation.cc:240] Negotiation successful
0808 10:00:57.699773 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"mutex_wait_us":1,"thread_start_us":112,"threads_started":1}
I20260808 10:00:57.700245 16630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.695420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58128 (local address 127.24.71.193:42975)
0808 10:00:57.695602 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:57.695605 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:57.695905 (+ 300us) server_negotiation.cc:407] Connection header received
0808 10:00:57.695953 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:57.695955 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:57.695971 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:57.696039 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:57.696248 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.697334 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.698485 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.699193 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.699309 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.699370 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:57.699914 (+ 544us) server_negotiation.cc:299] Negotiation successful
0808 10:00:57.699966 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":89,"threads_started":1}
I20260808 10:00:57.700649 16240 tablet_service.cc:1467] Processing CreateTablet for tablet d254245ddabe4607afbbec989e1b6c8d (DEFAULT_TABLE table=test-table [id=fdbe2c31892a40e9afbf59ba130cf9d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:00:57.700783 16482 tablet_service.cc:1467] Processing CreateTablet for tablet d254245ddabe4607afbbec989e1b6c8d (DEFAULT_TABLE table=test-table [id=fdbe2c31892a40e9afbf59ba130cf9d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:00:57.700856 15994 tablet_service.cc:1467] Processing CreateTablet for tablet d254245ddabe4607afbbec989e1b6c8d (DEFAULT_TABLE table=test-table [id=fdbe2c31892a40e9afbf59ba130cf9d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:00:57.701061 16240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d254245ddabe4607afbbec989e1b6c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:57.701148 15994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d254245ddabe4607afbbec989e1b6c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:57.701148 16482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d254245ddabe4607afbbec989e1b6c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:00:57.704031 16631 tablet_bootstrap.cc:492] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb: Bootstrap starting.
I20260808 10:00:57.704756 16631 tablet_bootstrap.cc:654] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:57.704730 16635 tablet_bootstrap.cc:492] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659: Bootstrap starting.
I20260808 10:00:57.704893 16634 tablet_bootstrap.cc:492] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Bootstrap starting.
I20260808 10:00:57.705374 16631 log.cc:824] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:57.705488 16635 tablet_bootstrap.cc:654] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:57.705549 16634 tablet_bootstrap.cc:654] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Neither blocks nor log segments found. Creating new log.
I20260808 10:00:57.706135 16631 tablet_bootstrap.cc:492] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb: No bootstrap required, opened a new log
I20260808 10:00:57.706125 16634 log.cc:824] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:57.706125 16635 log.cc:824] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659: Log is configured to *not* fsync() on all Append() calls
I20260808 10:00:57.706228 16631 ts_tablet_manager.cc:1397] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 10:00:57.706924 16634 tablet_bootstrap.cc:492] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: No bootstrap required, opened a new log
I20260808 10:00:57.707001 16634 ts_tablet_manager.cc:1397] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 10:00:57.707219 16635 tablet_bootstrap.cc:492] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659: No bootstrap required, opened a new log
I20260808 10:00:57.707293 16635 ts_tablet_manager.cc:1397] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 10:00:57.708195 16631 raft_consensus.cc:348] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:00:57.708395 16631 raft_consensus.cc:374] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:57.708442 16631 raft_consensus.cc:729] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e24c931395a497bba05a3d72e24c5fb, State: Initialized, Role: FOLLOWER
I20260808 10:00:57.708561 16631 consensus_queue.cc:260] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:00:57.708860 16631 ts_tablet_manager.cc:1428] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 10:00:57.709013 16357 heartbeater.cc:503] Master 127.24.71.254:35717 was elected leader, sending a full tablet report...
I20260808 10:00:57.709360 16635 raft_consensus.cc:348] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:00:57.709563 16635 raft_consensus.cc:374] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:57.709610 16635 raft_consensus.cc:729] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9cff9effdf84ccd97f443e8f29e3659, State: Initialized, Role: FOLLOWER
I20260808 10:00:57.709503 16634 raft_consensus.cc:348] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:00:57.709676 16634 raft_consensus.cc:374] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:00:57.709728 16634 raft_consensus.cc:729] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2aed0446a24f8ab297fac5759612c9, State: Initialized, Role: FOLLOWER
I20260808 10:00:57.709767 16635 consensus_queue.cc:260] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:00:57.709838 16634 consensus_queue.cc:260] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:00:57.710114 16635 ts_tablet_manager.cc:1428] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 10:00:57.710117 16634 ts_tablet_manager.cc:1428] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 10:00:57.710232 16121 heartbeater.cc:503] Master 127.24.71.254:35717 was elected leader, sending a full tablet report...
I20260808 10:00:57.710295 16603 heartbeater.cc:503] Master 127.24.71.254:35717 was elected leader, sending a full tablet report...
W20260808 10:00:57.751734 16359 tablet.cc:2369] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:00:57.800355 16641 raft_consensus.cc:482] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:00:57.800556 16641 raft_consensus.cc:504] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:00:57.800973 16641 leader_election.cc:288] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907), dd2aed0446a24f8ab297fac5759612c9 (127.24.71.193:42975)
I20260808 10:00:57.805152 16630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.801353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:60575 (local address 127.24.71.193:42975)
0808 10:00:57.801414 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:57.801416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:57.801423 (+ 7us) server_negotiation.cc:407] Connection header received
0808 10:00:57.801450 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:57.801450 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:57.801458 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:57.801508 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:57.801696 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.802474 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.804106 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.804716 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.804803 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.804813 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:57.805031 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 10:00:57.805075 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 10:00:57.805152 16627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.801281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:34169 (local address 127.24.71.194:41907)
0808 10:00:57.801362 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:57.801364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:57.801570 (+ 206us) server_negotiation.cc:407] Connection header received
0808 10:00:57.801607 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:57.801608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:57.801616 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:57.801680 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:00:57.801831 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.802515 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.804106 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.804716 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.804807 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.804816 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:57.805032 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 10:00:57.805075 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 10:00:57.805169 16605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.801189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:42975 (local address 127.24.71.195:60575)
0808 10:00:57.801271 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:57.801289 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:57.801375 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:57.801522 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:57.801523 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:57.801525 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:57.801606 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.801608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.802582 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.802583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.804002 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.804006 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.804840 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.804841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.804946 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.804947 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 10:00:57.805011 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 10:00:57.805065 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":119}
I20260808 10:00:57.805181 16642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.801195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:41907 (local address 127.24.71.195:34169)
0808 10:00:57.801498 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:57.801509 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:00:57.801560 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:00:57.801695 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:00:57.801696 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:00:57.801698 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:00:57.801767 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.801769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.802590 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.802590 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.804002 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:00:57.804006 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.804840 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.804841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:00:57.804942 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.804947 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 10:00:57.805011 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 10:00:57.805065 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":224,"thread_start_us":132,"threads_started":1}
I20260808 10:00:57.805564 16033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d254245ddabe4607afbbec989e1b6c8d" candidate_uuid: "d9cff9effdf84ccd97f443e8f29e3659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2aed0446a24f8ab297fac5759612c9" is_pre_election: true
I20260808 10:00:57.805565 16276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d254245ddabe4607afbbec989e1b6c8d" candidate_uuid: "d9cff9effdf84ccd97f443e8f29e3659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e24c931395a497bba05a3d72e24c5fb" is_pre_election: true
I20260808 10:00:57.805737 16276 raft_consensus.cc:2454] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9cff9effdf84ccd97f443e8f29e3659 in term 0.
I20260808 10:00:57.805764 16033 raft_consensus.cc:2454] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9cff9effdf84ccd97f443e8f29e3659 in term 0.
I20260808 10:00:57.805994 16392 leader_election.cc:302] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e24c931395a497bba05a3d72e24c5fb, d9cff9effdf84ccd97f443e8f29e3659; no voters:
I20260808 10:00:57.806161 16641 raft_consensus.cc:2781] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 10:00:57.806228 16641 raft_consensus.cc:482] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 10:00:57.806246 16641 raft_consensus.cc:3037] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:57.806977 16641 raft_consensus.cc:504] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:00:57.807130 16641 leader_election.cc:288] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [CANDIDATE]: Term 1 election: Requested vote from peers 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907), dd2aed0446a24f8ab297fac5759612c9 (127.24.71.193:42975)
I20260808 10:00:57.807456 16033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d254245ddabe4607afbbec989e1b6c8d" candidate_uuid: "d9cff9effdf84ccd97f443e8f29e3659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2aed0446a24f8ab297fac5759612c9"
I20260808 10:00:57.807493 16276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d254245ddabe4607afbbec989e1b6c8d" candidate_uuid: "d9cff9effdf84ccd97f443e8f29e3659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e24c931395a497bba05a3d72e24c5fb"
I20260808 10:00:57.807554 16033 raft_consensus.cc:3037] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:57.807591 16276 raft_consensus.cc:3037] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:00:57.808511 16033 raft_consensus.cc:2454] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9cff9effdf84ccd97f443e8f29e3659 in term 1.
I20260808 10:00:57.808511 16276 raft_consensus.cc:2454] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9cff9effdf84ccd97f443e8f29e3659 in term 1.
I20260808 10:00:57.808722 16402 leader_election.cc:302] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9cff9effdf84ccd97f443e8f29e3659, dd2aed0446a24f8ab297fac5759612c9; no voters:
I20260808 10:00:57.808871 16641 raft_consensus.cc:2781] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:00:57.809069 16641 raft_consensus.cc:686] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [term 1 LEADER]: Becoming Leader. State: Replica: d9cff9effdf84ccd97f443e8f29e3659, State: Running, Role: LEADER
I20260808 10:00:57.809177 16641 consensus_queue.cc:237] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:00:57.810120 15795 catalog_manager.cc:5495] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195). New cstate: current_term: 1 leader_uuid: "d9cff9effdf84ccd97f443e8f29e3659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260808 10:00:57.816828 16628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.814267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43986 (local address 127.24.71.195:33367)
0808 10:00:57.814339 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 10:00:57.814341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:00:57.814349 (+ 8us) server_negotiation.cc:407] Connection header received
0808 10:00:57.814380 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:00:57.814381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:00:57.814398 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:00:57.814458 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:00:57.814568 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.815041 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.815872 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:00:57.816061 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:00:57.816114 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:00:57.816359 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:00:57.816510 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:00:57.816619 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 10:00:57.816712 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 10:00:57.816741 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 10:00:57.818848 16033 raft_consensus.cc:1261] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Refusing update from remote peer d9cff9effdf84ccd97f443e8f29e3659: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:00:57.818851 16276 raft_consensus.cc:1261] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb [term 1 FOLLOWER]: Refusing update from remote peer d9cff9effdf84ccd97f443e8f29e3659: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:00:57.819217 16641 consensus_queue.cc:1035] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:00:57.819347 16643 consensus_queue.cc:1035] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:00:57.821758 16649 mvcc.cc:205] Tried to move back new op lower bound from 7316206624022958080 to 7316206623987191808. Current Snapshot: MvccSnapshot[applied={T|T < 7316206624022958080}]
I20260808 10:00:57.822100 16652 mvcc.cc:205] Tried to move back new op lower bound from 7316206624022958080 to 7316206623987191808. Current Snapshot: MvccSnapshot[applied={T|T < 7316206624022958080}]
I20260808 10:00:57.822930 16650 mvcc.cc:205] Tried to move back new op lower bound from 7316206624022958080 to 7316206623987191808. Current Snapshot: MvccSnapshot[applied={T|T < 7316206624022958080}]
I20260808 10:00:57.824364 15795 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:00:57.824471 15795 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:00:57.825311 15795 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Sending DeleteTablet for 3 replicas of tablet d254245ddabe4607afbbec989e1b6c8d
I20260808 10:00:57.825659 16482 tablet_service.cc:1514] Processing DeleteTablet for tablet d254245ddabe4607afbbec989e1b6c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:57 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:43978
I20260808 10:00:57.825675 16240 tablet_service.cc:1514] Processing DeleteTablet for tablet d254245ddabe4607afbbec989e1b6c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:57 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:46598
I20260808 10:00:57.826124 16671 tablet_replica.cc:330] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659: stopping tablet replica
I20260808 10:00:57.826102 15994 tablet_service.cc:1514] Processing DeleteTablet for tablet d254245ddabe4607afbbec989e1b6c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:57 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:58128
I20260808 10:00:57.826164 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 15898
I20260808 10:00:57.826227 16671 raft_consensus.cc:2229] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [term 1 LEADER]: Raft consensus shutting down.
I20260808 10:00:57.852384 16671 raft_consensus.cc:2258] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:00:57.852500 16676 tablet_replica.cc:330] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb: stopping tablet replica
I20260808 10:00:57.852677 16676 raft_consensus.cc:2229] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:00:57.852825 16676 raft_consensus.cc:2258] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:00:57.853515 16671 ts_tablet_manager.cc:1905] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:00:57.853515 16676 ts_tablet_manager.cc:1905] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:00:57.855306 16676 ts_tablet_manager.cc:1918] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:00:57.855307 16671 ts_tablet_manager.cc:1918] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:00:57.855423 16671 log.cc:1196] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/d254245ddabe4607afbbec989e1b6c8d
I20260808 10:00:57.855576 16676 log.cc:1196] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/d254245ddabe4607afbbec989e1b6c8d
I20260808 10:00:57.855768 16671 ts_tablet_manager.cc:1939] T d254245ddabe4607afbbec989e1b6c8d P d9cff9effdf84ccd97f443e8f29e3659: Deleting consensus metadata
I20260808 10:00:57.855999 16676 ts_tablet_manager.cc:1939] T d254245ddabe4607afbbec989e1b6c8d P 4e24c931395a497bba05a3d72e24c5fb: Deleting consensus metadata
I20260808 10:00:57.856278 15777 catalog_manager.cc:4841] TS d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367): tablet d254245ddabe4607afbbec989e1b6c8d (table test-table [id=fdbe2c31892a40e9afbf59ba130cf9d1]) successfully deleted
I20260808 10:00:57.856531 15773 catalog_manager.cc:4841] TS 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907): tablet d254245ddabe4607afbbec989e1b6c8d (table test-table [id=fdbe2c31892a40e9afbf59ba130cf9d1]) successfully deleted
W20260808 10:00:57.857880 15778 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:42975 (error 108)
I20260808 10:00:57.858430 16624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:00:57.858288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:42975 (local address 127.0.0.1:58138)
0808 10:00:57.858347 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 10:00:57.858385 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:42975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 10:00:57.858561 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 16128
W20260808 10:00:57.869199 15778 catalog_manager.cc:4584] TS dd2aed0446a24f8ab297fac5759612c9 (127.24.71.193:42975): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d254245ddabe4607afbbec989e1b6c8d: Network error: Client connection negotiation failed: client connection to 127.24.71.193:42975: connect: Connection refused (error 111)
I20260808 10:00:57.873772 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 16364
I20260808 10:00:57.885026 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 15747
I20260808 10:01:17.898381 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:35717
--webserver_interface=127.24.71.254
--webserver_port=37709
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:35717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:01:17.989802 16683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:17.990072 16683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:17.990113 16683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:17.991587 16683 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 10:01:17.991665 16683 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 10:01:17.991690 16683 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 10:01:17.991721 16683 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:01:17.991755 16683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:17.991786 16683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:17.991832 16683 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:01:17.991861 16683 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:01:17.993654 16683 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:35717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:35717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=37709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:17.993988 16683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:17.994247 16683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:18.004638 16695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:18.004624 16696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:18.004768 16683 server_base.cc:1034] running on GCE node
W20260808 10:01:18.004629 16700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:18.005349 16683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:18.005728 16683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:18.006919 16683 hybrid_clock.cc:648] HybridClock initialized: now 1786183278006895 us; error 47 us; skew 500 ppm
Aug 08 10:01:18 dist-test-slave-gw5c krb5kdc[15723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183278, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:18.009920 16683 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:01:18.010489 16683 webserver.cc:460] Webserver started at http://127.24.71.254:37709/ using document root <none> and password file <none>
I20260808 10:01:18.010771 16683 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:18.010871 16683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:18.012499 16683 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:18.013221 16709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:18.013407 16683 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:01:18.013525 16683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "3d46b6deac354c6d9b099aa764eca348"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "b4bd68b6488286758200d3d35f2b55e2"
server_key_iv: "e4ea452808db83a4c360395c940fdd79"
server_key_version: "encryptionkey@0"
I20260808 10:01:18.013959 16683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:18.046217 16683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:18.048835 16683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:18.049024 16683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:18.054081 16683 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:35717
I20260808 10:01:18.054122 16808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:35717 every 8 connection(s)
I20260808 10:01:18.054579 16683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:01:18.055680 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 16683
I20260808 10:01:18.055991 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:42975
--local_ip_for_outbound_sockets=127.24.71.193
--tserver_master_addrs=127.24.71.254:35717
--webserver_port=43379
--webserver_interface=127.24.71.193
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:01:18.056696 16809 sys_catalog.cc:263] Verifying existing consensus state
I20260808 10:01:18.057849 16809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Bootstrap starting.
I20260808 10:01:18.067864 16809 log.cc:824] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:18.070194 16809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 10:01:18.070590 16809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Bootstrap complete.
I20260808 10:01:18.073133 16809 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } }
I20260808 10:01:18.073396 16809 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d46b6deac354c6d9b099aa764eca348, State: Initialized, Role: FOLLOWER
I20260808 10:01:18.073580 16809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } }
I20260808 10:01:18.073653 16809 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:01:18.073712 16809 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:01:18.073765 16809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 1 FOLLOWER]: Advancing to term 2
I20260808 10:01:18.074860 16809 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } }
I20260808 10:01:18.074954 16809 leader_election.cc:302] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d46b6deac354c6d9b099aa764eca348; no voters:
I20260808 10:01:18.075205 16809 leader_election.cc:288] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 10:01:18.075246 16814 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 10:01:18.075366 16814 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 2 LEADER]: Becoming Leader. State: Replica: 3d46b6deac354c6d9b099aa764eca348, State: Running, Role: LEADER
I20260808 10:01:18.075568 16814 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } }
I20260808 10:01:18.075541 16809 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:01:18.075871 16815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3d46b6deac354c6d9b099aa764eca348" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } } }
I20260808 10:01:18.076085 16815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: This master's current role is: LEADER
I20260808 10:01:18.075860 16817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d46b6deac354c6d9b099aa764eca348. Latest consensus state: current_term: 2 leader_uuid: "3d46b6deac354c6d9b099aa764eca348" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } } }
I20260808 10:01:18.076347 16817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: This master's current role is: LEADER
I20260808 10:01:18.076496 16820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:01:18.077448 16820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:01:18.077571 16820 catalog_manager.cc:1259] Loaded cluster ID: 9eb5b474bb36487db049a8c7b80d4e75
I20260808 10:01:18.077831 16820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:01:18.078648 16820 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:01:18.078851 16820 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Loaded TSK: 0
I20260808 10:01:18.086933 16820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Generated new TSK 1
I20260808 10:01:18.087064 16820 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 10:01:18.155236 16812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:18.155557 16812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:18.155606 16812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:18.156838 16812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:18.156910 16812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:18.156956 16812 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:01:18.158496 16812 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:42975
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=43379
--tserver_master_addrs=127.24.71.254:35717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:18.158777 16812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:18.159050 16812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:18.165355 16849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:18.165387 16847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:18.165374 16852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:18.165650 16812 server_base.cc:1034] running on GCE node
I20260808 10:01:18.165894 16812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:18.166201 16812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:18.167435 16812 hybrid_clock.cc:648] HybridClock initialized: now 1786183278167410 us; error 40 us; skew 500 ppm
Aug 08 10:01:18 dist-test-slave-gw5c krb5kdc[15723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183278, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:18.170747 16812 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 10:01:18.171239 16812 webserver.cc:460] Webserver started at http://127.24.71.193:43379/ using document root <none> and password file <none>
I20260808 10:01:18.171552 16812 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:18.171640 16812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:18.173178 16812 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:18.174041 16868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:18.174314 16812 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:18.174440 16812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "dd2aed0446a24f8ab297fac5759612c9"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "7b99934e331a335368b34a3cf6467dfd"
server_key_iv: "045737c38e93f21ea47f353268155d73"
server_key_version: "encryptionkey@0"
I20260808 10:01:18.174850 16812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:18.186599 16812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:18.189096 16812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:18.189271 16812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:18.189546 16812 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:18.190019 16880 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 10:01:18.191589 16812 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 10:01:18.191643 16812 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 10:01:18.191669 16812 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 10:01:18.192354 16812 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 10:01:18.192402 16812 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 10:01:18.192451 16880 tablet_bootstrap.cc:492] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Bootstrap starting.
I20260808 10:01:18.201339 16812 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:42975
I20260808 10:01:18.201547 17070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:42975 every 8 connection(s)
I20260808 10:01:18.201907 16812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 10:01:18.202549 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 16812
I20260808 10:01:18.202870 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:41907
--local_ip_for_outbound_sockets=127.24.71.194
--tserver_master_addrs=127.24.71.254:35717
--webserver_port=46413
--webserver_interface=127.24.71.194
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:01:18.206065 16880 log.cc:824] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:18.209276 16880 tablet_bootstrap.cc:492] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 10:01:18.209612 16880 tablet_bootstrap.cc:492] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Bootstrap complete.
I20260808 10:01:18.211284 16880 ts_tablet_manager.cc:1397] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.008s
I20260808 10:01:18.212707 16880 raft_consensus.cc:348] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:18.213037 16880 raft_consensus.cc:729] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2aed0446a24f8ab297fac5759612c9, State: Initialized, Role: FOLLOWER
I20260808 10:01:18.213165 16880 consensus_queue.cc:260] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:18.213451 16880 ts_tablet_manager.cc:1428] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Time spent starting tablet: real 0.002s user 0.003s sys 0.003s
Aug 08 10:01:18 dist-test-slave-gw5c krb5kdc[15723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183278, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:01:18.219774 17075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.205258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:52951)
0808 10:01:18.205677 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:18.205730 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:18.206437 (+ 707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:18.206941 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:18.206945 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:18.207244 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:18.207541 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.207551 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.209356 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.209357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.210751 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.210755 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.211710 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.211712 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.211902 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.212612 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:01:18.212624 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:18.214688 (+ 2064us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:18.217594 (+ 2906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:18.217604 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:18.217607 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:18.217961 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:18.218300 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:18.218301 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:18.218302 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:18.218446 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:18.219014 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:18.219022 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:18.219188 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 10:01:18.219317 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 10:01:18.219535 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":128,"threads_started":1}
I20260808 10:01:18.219957 17076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.205353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:52951 (local address 127.24.71.254:35717)
0808 10:01:18.205566 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:18.205577 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:18.205897 (+ 320us) server_negotiation.cc:407] Connection header received
0808 10:01:18.206666 (+ 769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:18.206673 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:18.206721 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:18.206895 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:18.207710 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.209197 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.210886 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.211566 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.214860 (+ 3294us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.214957 (+ 97us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:18.214961 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:18.214962 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:18.214973 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:18.217469 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:18.218059 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:18.218063 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:18.218064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:18.218211 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:18.218531 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:18.218532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:18.218533 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:18.218912 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:18.219034 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:18.219445 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 10:01:18.219628 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":93,"threads_started":1}
I20260808 10:01:18.221083 17072 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35717
I20260808 10:01:18.221177 17072 heartbeater.cc:464] Registering TS with master...
I20260808 10:01:18.221364 17072 heartbeater.cc:511] Master 127.24.71.254:35717 requested a full tablet report, sending...
I20260808 10:01:18.222174 16738 ts_manager.cc:194] Registered new tserver with Master: dd2aed0446a24f8ab297fac5759612c9 (127.24.71.193:42975)
I20260808 10:01:18.223461 16738 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:52951
I20260808 10:01:18.224524 17072 heartbeater.cc:503] Master 127.24.71.254:35717 was elected leader, sending a full tablet report...
I20260808 10:01:18.231657 17082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.224327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55274 (local address 127.24.71.193:42975)
0808 10:01:18.227529 (+ 3202us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:18.227534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:18.227613 (+ 79us) server_negotiation.cc:407] Connection header received
0808 10:01:18.227711 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:18.227713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:18.227730 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:18.227825 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:18.227978 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.229100 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.230461 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.231171 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.231339 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.231455 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:18.231529 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 10:01:18.231573 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3164,"thread_start_us":82,"threads_started":1}
I20260808 10:01:18.231655 17080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.223955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:42975 (local address 127.0.0.1:55274)
0808 10:01:18.227517 (+ 3562us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:18.227557 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:18.227636 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:18.227836 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:18.227839 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:18.227841 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:18.227908 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.227909 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.229198 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.229199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.230364 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.230368 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.231277 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.231279 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.231361 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.231375 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 10:01:18.231518 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 10:01:18.231576 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3526,"thread_start_us":109,"threads_started":1}
I20260808 10:01:18.232525 16948 tablet_service.cc:1514] Processing DeleteTablet for tablet d254245ddabe4607afbbec989e1b6c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:00:57 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:55274
I20260808 10:01:18.233173 17084 tablet_replica.cc:330] stopping tablet replica
I20260808 10:01:18.233314 17084 raft_consensus.cc:2229] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:01:18.233415 17084 raft_consensus.cc:2258] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:01:18.233757 17084 ts_tablet_manager.cc:1905] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:01:18.235993 17084 ts_tablet_manager.cc:1918] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:01:18.236109 17084 log.cc:1196] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal/wals/d254245ddabe4607afbbec989e1b6c8d
I20260808 10:01:18.236457 17084 ts_tablet_manager.cc:1939] T d254245ddabe4607afbbec989e1b6c8d P dd2aed0446a24f8ab297fac5759612c9: Deleting consensus metadata
I20260808 10:01:18.237074 16717 catalog_manager.cc:4841] TS dd2aed0446a24f8ab297fac5759612c9 (127.24.71.193:42975): tablet d254245ddabe4607afbbec989e1b6c8d (table test-table [id=fdbe2c31892a40e9afbf59ba130cf9d1]) successfully deleted
W20260808 10:01:18.299425 17074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:18.299642 17074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:18.299667 17074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:18.300941 17074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:18.300990 17074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:18.301018 17074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:01:18.302423 17074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:41907
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=46413
--tserver_master_addrs=127.24.71.254:35717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:18.302618 17074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:18.302799 17074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:18.307972 17096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:18.307966 17100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:18.307966 17098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:18.308208 17074 server_base.cc:1034] running on GCE node
I20260808 10:01:18.308496 17074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:18.308758 17074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:18.309954 17074 hybrid_clock.cc:648] HybridClock initialized: now 1786183278309948 us; error 38 us; skew 500 ppm
Aug 08 10:01:18 dist-test-slave-gw5c krb5kdc[15723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183278, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:18.312724 17074 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 10:01:18.313218 17074 webserver.cc:460] Webserver started at http://127.24.71.194:46413/ using document root <none> and password file <none>
I20260808 10:01:18.313462 17074 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:18.313537 17074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:18.314970 17074 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:01:18.315694 17110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:18.315923 17074 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:18.316001 17074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "4e24c931395a497bba05a3d72e24c5fb"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "c08d5d65ec6b70a729cf3c16e30bbfa7"
server_key_iv: "dbf30b39a914d38e04604a36e43c6556"
server_key_version: "encryptionkey@0"
I20260808 10:01:18.316468 17074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:18.334314 17074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:18.336612 17074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:18.336783 17074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:18.337059 17074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:18.337411 17074 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:01:18.337446 17074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:18.337471 17074 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:01:18.337512 17074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:18.344072 17074 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:41907
I20260808 10:01:18.344126 17295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:41907 every 8 connection(s)
I20260808 10:01:18.344491 17074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
Aug 08 10:01:18 dist-test-slave-gw5c krb5kdc[15723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183278, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:01:18.353793 17076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.345217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:60525 (local address 127.24.71.254:35717)
0808 10:01:18.345314 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:18.345316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:18.345519 (+ 203us) server_negotiation.cc:407] Connection header received
0808 10:01:18.346041 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:18.346042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:18.346055 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:18.346119 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:18.347132 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.347743 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.348769 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.348963 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.349017 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.351175 (+ 2158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:18.351177 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:18.351177 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:18.351184 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:18.352472 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:18.352842 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:18.352842 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:18.352843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:18.352894 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:18.353166 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:18.353166 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:18.353166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:18.353264 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:18.353316 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:18.353632 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 10:01:18.353716 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 10:01:18.353789 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 17074
I20260808 10:01:18.354067 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:33367
--local_ip_for_outbound_sockets=127.24.71.195
--tserver_master_addrs=127.24.71.254:35717
--webserver_port=33861
--webserver_interface=127.24.71.195
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:01:18.354082 17300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.345170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:60525)
0808 10:01:18.345386 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:18.345430 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:18.345953 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:18.346199 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:18.346203 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:18.346799 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:18.347014 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.347019 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.347844 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.347845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.348681 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.348684 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.349040 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.349041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.349152 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.349669 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:01:18.349677 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:18.351088 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:18.352549 (+ 1461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:18.352555 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:18.352557 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:18.352776 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:18.352976 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:18.352978 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:18.352978 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:18.353100 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:18.353344 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:18.353351 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:18.353469 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 10:01:18.353612 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 10:01:18.353817 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":135,"threads_started":1}
I20260808 10:01:18.354761 17296 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35717
I20260808 10:01:18.354877 17296 heartbeater.cc:464] Registering TS with master...
I20260808 10:01:18.355062 17296 heartbeater.cc:511] Master 127.24.71.254:35717 requested a full tablet report, sending...
I20260808 10:01:18.355698 16738 ts_manager.cc:194] Registered new tserver with Master: 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907)
I20260808 10:01:18.356225 16738 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:60525
W20260808 10:01:18.441419 17301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:18.441743 17301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:18.441797 17301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:18.443102 17301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:18.443194 17301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:18.443240 17301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:01:18.444881 17301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:33367
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=33861
--tserver_master_addrs=127.24.71.254:35717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:18.445191 17301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:18.445467 17301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:18.451045 17311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:18.451045 17309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:18.451107 17314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:18.451359 17301 server_base.cc:1034] running on GCE node
I20260808 10:01:18.451632 17301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:18.451913 17301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:18.453117 17301 hybrid_clock.cc:648] HybridClock initialized: now 1786183278453098 us; error 39 us; skew 500 ppm
Aug 08 10:01:18 dist-test-slave-gw5c krb5kdc[15723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183278, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:18.456059 17301 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 10:01:18.456573 17301 webserver.cc:460] Webserver started at http://127.24.71.195:33861/ using document root <none> and password file <none>
I20260808 10:01:18.456818 17301 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:18.456910 17301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:18.458487 17301 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:18.459160 17322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:18.459359 17301 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:18.459496 17301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "d9cff9effdf84ccd97f443e8f29e3659"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "e65c8d41ad12b584b5cbc76d4592ee91"
server_key_iv: "a453c70af5412126993ff43809616795"
server_key_version: "encryptionkey@0"
I20260808 10:01:18.459865 17301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:18.484688 17301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:18.486812 17301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:18.487001 17301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:18.487268 17301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:18.487666 17301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:01:18.487726 17301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:18.487772 17301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:01:18.487821 17301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:18.494203 17301 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:33367
I20260808 10:01:18.494262 17502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:33367 every 8 connection(s)
I20260808 10:01:18.494621 17301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
Aug 08 10:01:18 dist-test-slave-gw5c krb5kdc[15723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183278, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:01:18.501222 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 17301
I20260808 10:01:18.504881 17076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.495463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:57063 (local address 127.24.71.254:35717)
0808 10:01:18.495589 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:18.495591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:18.495768 (+ 177us) server_negotiation.cc:407] Connection header received
0808 10:01:18.496258 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:18.496258 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:18.496267 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:18.496351 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:18.497331 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.497808 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.498818 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.499016 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.499071 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.501371 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:18.501374 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:18.501374 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:18.501384 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:18.503284 (+ 1900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:18.503776 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:18.503777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:18.503778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:18.503839 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:18.504181 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:18.504182 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:18.504182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:18.504295 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:18.504390 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:18.504696 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 10:01:18.504783 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 10:01:18.505039 17509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.495436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:57063)
0808 10:01:18.495628 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:18.495672 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:18.496171 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:18.496415 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:18.496419 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:18.497032 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:18.497235 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.497239 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.497899 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.497900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.498732 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.498734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.499094 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.499094 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.499200 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.499799 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:01:18.499808 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:18.501237 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:18.503364 (+ 2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:18.503372 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:18.503373 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:18.503695 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:18.503906 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:18.503907 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:18.503907 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:18.504081 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:18.504362 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:18.504369 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:18.504540 (+ 171us) client_negotiation.cc:769] Sending connection context
0808 10:01:18.504651 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 10:01:18.504788 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":117,"threads_started":1}
I20260808 10:01:18.505576 17507 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35717
I20260808 10:01:18.505677 17507 heartbeater.cc:464] Registering TS with master...
I20260808 10:01:18.505889 17507 heartbeater.cc:511] Master 127.24.71.254:35717 requested a full tablet report, sending...
I20260808 10:01:18.506286 16738 ts_manager.cc:194] Registered new tserver with Master: d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367)
I20260808 10:01:18.506613 16738 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:57063
I20260808 10:01:18.509219 17512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.501715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52108 (local address 127.24.71.254:35717)
0808 10:01:18.501842 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:18.501844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:18.501987 (+ 143us) server_negotiation.cc:407] Connection header received
0808 10:01:18.502036 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:18.502037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:18.502052 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:18.502129 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:18.502850 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.503600 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.504582 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.504878 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.504951 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.506754 (+ 1803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:18.506756 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:18.506756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:18.506763 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:18.508292 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:18.508607 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:18.508608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:18.508608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:18.508657 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:18.508819 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:18.508819 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:18.508819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:18.508906 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:18.509031 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:18.509060 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 10:01:18.509124 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":78,"threads_started":1}
I20260808 10:01:18.509967 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 10:01:18.512568 17512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.510280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52122 (local address 127.24.71.254:35717)
0808 10:01:18.510346 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:18.510348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:18.510476 (+ 128us) server_negotiation.cc:407] Connection header received
0808 10:01:18.510522 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:18.510523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:18.510552 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:18.510613 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:01:18.510681 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.511161 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.512003 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.512198 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.512251 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.512372 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:01:18.512415 (+ 43us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 10:01:18.512526 (+ 111us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52122: token expired
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 10:01:18.512611 17512 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52122: token expired
W20260808 10:01:18.512814 16606 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.24.71.254:35717)
I20260808 10:01:18.518751 17512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.513115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52130 (local address 127.24.71.254:35717)
0808 10:01:18.513163 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:18.513165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:18.513173 (+ 8us) server_negotiation.cc:407] Connection header received
0808 10:01:18.513217 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:18.513218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:18.513225 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:18.513271 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:18.513697 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.514119 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.514761 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.514933 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.514985 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.516123 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:18.516125 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:18.516125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:18.516131 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:18.517455 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:18.517804 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:18.517805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:18.517806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:18.517865 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:18.518157 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:18.518158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:18.518158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:18.518346 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:18.518441 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:18.518614 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 10:01:18.518687 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 10:01:18.520160 16738 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 10:01:18.521806 16738 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 10:01:18.524413 16948 tablet_service.cc:1467] Processing CreateTablet for tablet 9a05f4341e114f1f8eb5c3510050af66 (DEFAULT_TABLE table=test-table [id=f7b47dc69cf445dfbefc63ce7328caf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:01:18.524638 16948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a05f4341e114f1f8eb5c3510050af66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:18.526516 16880 tablet_bootstrap.cc:492] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9: Bootstrap starting.
I20260808 10:01:18.526890 16880 tablet_bootstrap.cc:654] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:18.527535 16880 tablet_bootstrap.cc:492] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9: No bootstrap required, opened a new log
I20260808 10:01:18.527590 16880 ts_tablet_manager.cc:1397] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 10:01:18.527704 16880 raft_consensus.cc:348] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:18.527789 16880 raft_consensus.cc:374] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:18.527848 16880 raft_consensus.cc:729] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2aed0446a24f8ab297fac5759612c9, State: Initialized, Role: FOLLOWER
I20260808 10:01:18.527904 16880 consensus_queue.cc:260] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:18.527995 17080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.524062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:33367 (local address 127.0.0.1:48552)
0808 10:01:18.524106 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:18.524118 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:18.524158 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:18.524616 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:18.524617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:18.524619 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:18.524674 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.524675 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.525763 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.525764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.526504 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.526506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.527757 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.527758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.527827 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.527831 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:01:18.527868 (+ 37us) client_negotiation.cc:240] Negotiation successful
0808 10:01:18.527921 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 10:01:18.528008 16880 ts_tablet_manager.cc:1428] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 10:01:18.528357 17519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.524212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48552 (local address 127.24.71.195:33367)
0808 10:01:18.524425 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:18.524430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:18.524448 (+ 18us) server_negotiation.cc:407] Connection header received
0808 10:01:18.524485 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:18.524487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:18.524522 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:18.524606 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:18.524728 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.525663 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.526638 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.527642 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.528106 (+ 464us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.528188 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:18.528217 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 10:01:18.528254 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":132,"threads_started":1}
I20260808 10:01:18.529026 17407 tablet_service.cc:1467] Processing CreateTablet for tablet 9a05f4341e114f1f8eb5c3510050af66 (DEFAULT_TABLE table=test-table [id=f7b47dc69cf445dfbefc63ce7328caf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:01:18.529392 17407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a05f4341e114f1f8eb5c3510050af66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:18.530571 17517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.524062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:41907 (local address 127.0.0.1:54910)
0808 10:01:18.524240 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:18.524248 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:18.524299 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:18.527298 (+ 2999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:18.527299 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:18.527301 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:18.527349 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.527351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.528684 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.528684 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.529593 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.529596 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.530318 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.530319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.530386 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.530390 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:01:18.530450 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 10:01:18.530493 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":19,"thread_start_us":65,"threads_started":1}
I20260808 10:01:18.530586 17520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.526583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54910 (local address 127.24.71.194:41907)
0808 10:01:18.526828 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:18.526832 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:18.526841 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:01:18.526875 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:18.526877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:18.526888 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:18.526989 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:18.527474 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.528587 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.529700 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.530200 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.530314 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.530376 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:18.530465 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 10:01:18.530506 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":111,"threads_started":1}
I20260808 10:01:18.531453 17188 tablet_service.cc:1467] Processing CreateTablet for tablet 9a05f4341e114f1f8eb5c3510050af66 (DEFAULT_TABLE table=test-table [id=f7b47dc69cf445dfbefc63ce7328caf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:01:18.531788 17188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a05f4341e114f1f8eb5c3510050af66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:18.532704 17522 tablet_bootstrap.cc:492] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659: Bootstrap starting.
I20260808 10:01:18.533324 17522 tablet_bootstrap.cc:654] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:18.533849 17522 log.cc:824] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:18.534633 17522 tablet_bootstrap.cc:492] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659: No bootstrap required, opened a new log
I20260808 10:01:18.534696 17522 ts_tablet_manager.cc:1397] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 10:01:18.535074 17525 tablet_bootstrap.cc:492] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: Bootstrap starting.
I20260808 10:01:18.535822 17525 tablet_bootstrap.cc:654] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:18.536433 17525 log.cc:824] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:18.536922 17522 raft_consensus.cc:348] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:18.537128 17522 raft_consensus.cc:374] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:18.537170 17522 raft_consensus.cc:729] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9cff9effdf84ccd97f443e8f29e3659, State: Initialized, Role: FOLLOWER
I20260808 10:01:18.537289 17522 consensus_queue.cc:260] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:18.537341 17525 tablet_bootstrap.cc:492] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: No bootstrap required, opened a new log
I20260808 10:01:18.537405 17525 ts_tablet_manager.cc:1397] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 10:01:18.537591 17522 ts_tablet_manager.cc:1428] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 10:01:18.537719 17507 heartbeater.cc:503] Master 127.24.71.254:35717 was elected leader, sending a full tablet report...
I20260808 10:01:18.539445 17525 raft_consensus.cc:348] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:18.539615 17525 raft_consensus.cc:374] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:18.539639 17525 raft_consensus.cc:729] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e24c931395a497bba05a3d72e24c5fb, State: Initialized, Role: FOLLOWER
I20260808 10:01:18.539750 17525 consensus_queue.cc:260] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:18.540022 17525 ts_tablet_manager.cc:1428] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 10:01:18.540079 17296 heartbeater.cc:503] Master 127.24.71.254:35717 was elected leader, sending a full tablet report...
W20260808 10:01:18.595091 17298 tablet.cc:2369] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 10:01:18.702905 17073 tablet.cc:2369] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 10:01:18.745349 17508 tablet.cc:2369] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:01:18.820215 17079 raft_consensus.cc:482] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:01:18.820441 17079 raft_consensus.cc:504] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:18.820889 17079 leader_election.cc:288] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907), d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367)
I20260808 10:01:18.823985 17520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.821149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:48465 (local address 127.24.71.194:41907)
0808 10:01:18.821199 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:18.821201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:18.821336 (+ 135us) server_negotiation.cc:407] Connection header received
0808 10:01:18.821434 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:18.821435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:18.821451 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:18.821518 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:18.821674 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.822170 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.823184 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.823621 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.823708 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.823717 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:18.823872 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 10:01:18.823912 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 10:01:18.823992 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.821090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:41907 (local address 127.24.71.193:48465)
0808 10:01:18.821230 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:18.821241 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:18.821359 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:18.821522 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:18.821523 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:18.821525 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:18.821585 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.821588 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.822266 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.822267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.823085 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.823087 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.823710 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.823711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.823793 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.823797 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:01:18.823865 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 10:01:18.823911 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":7,"thread_start_us":67,"threads_started":1}
I20260808 10:01:18.824059 17519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.821224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:38381 (local address 127.24.71.195:33367)
0808 10:01:18.821287 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:18.821289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:18.821358 (+ 69us) server_negotiation.cc:407] Connection header received
0808 10:01:18.821459 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:18.821460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:18.821471 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:18.821553 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:18.821735 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.822211 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.823201 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.823658 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.823773 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.823783 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:18.823943 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 10:01:18.823985 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 10:01:18.824261 17534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.821099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:33367 (local address 127.24.71.193:38381)
0808 10:01:18.821261 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:18.821274 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:18.821365 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:18.821556 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:18.821557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:18.821560 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:18.821628 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.821631 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.822307 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.822309 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.823092 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:18.823094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.823775 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.823776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:18.823840 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.823844 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:01:18.823934 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 10:01:18.823980 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":23,"thread_start_us":64,"threads_started":1}
I20260808 10:01:18.824641 17221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a05f4341e114f1f8eb5c3510050af66" candidate_uuid: "dd2aed0446a24f8ab297fac5759612c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e24c931395a497bba05a3d72e24c5fb" is_pre_election: true
I20260808 10:01:18.824666 17438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a05f4341e114f1f8eb5c3510050af66" candidate_uuid: "dd2aed0446a24f8ab297fac5759612c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cff9effdf84ccd97f443e8f29e3659" is_pre_election: true
I20260808 10:01:18.824828 17221 raft_consensus.cc:2454] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2aed0446a24f8ab297fac5759612c9 in term 0.
I20260808 10:01:18.824831 17438 raft_consensus.cc:2454] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2aed0446a24f8ab297fac5759612c9 in term 0.
I20260808 10:01:18.825093 16870 leader_election.cc:302] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e24c931395a497bba05a3d72e24c5fb, dd2aed0446a24f8ab297fac5759612c9; no voters:
I20260808 10:01:18.825228 17079 raft_consensus.cc:2781] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 10:01:18.825289 17079 raft_consensus.cc:482] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 10:01:18.825330 17079 raft_consensus.cc:3037] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:18.826066 17079 raft_consensus.cc:504] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:18.826232 17079 leader_election.cc:288] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 1 election: Requested vote from peers 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907), d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367)
I20260808 10:01:18.826406 17221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a05f4341e114f1f8eb5c3510050af66" candidate_uuid: "dd2aed0446a24f8ab297fac5759612c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e24c931395a497bba05a3d72e24c5fb"
I20260808 10:01:18.826459 17438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a05f4341e114f1f8eb5c3510050af66" candidate_uuid: "dd2aed0446a24f8ab297fac5759612c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cff9effdf84ccd97f443e8f29e3659"
I20260808 10:01:18.826519 17221 raft_consensus.cc:3037] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:18.826560 17438 raft_consensus.cc:3037] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:18.827334 17221 raft_consensus.cc:2454] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2aed0446a24f8ab297fac5759612c9 in term 1.
I20260808 10:01:18.827466 17438 raft_consensus.cc:2454] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2aed0446a24f8ab297fac5759612c9 in term 1.
I20260808 10:01:18.827606 16870 leader_election.cc:302] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e24c931395a497bba05a3d72e24c5fb, dd2aed0446a24f8ab297fac5759612c9; no voters:
I20260808 10:01:18.827737 17079 raft_consensus.cc:2781] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:01:18.827917 17079 raft_consensus.cc:686] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 LEADER]: Becoming Leader. State: Replica: dd2aed0446a24f8ab297fac5759612c9, State: Running, Role: LEADER
I20260808 10:01:18.828028 17079 consensus_queue.cc:237] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:18.828900 16737 catalog_manager.cc:5495] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd2aed0446a24f8ab297fac5759612c9 (127.24.71.193). New cstate: current_term: 1 leader_uuid: "dd2aed0446a24f8ab297fac5759612c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } health_report { overall_health: HEALTHY } } }
I20260808 10:01:18.882932 17540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.880067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55280 (local address 127.24.71.193:42975)
0808 10:01:18.880265 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:18.880267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:18.880276 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:01:18.880320 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:18.880321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:18.880343 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:18.880431 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:01:18.880576 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.881068 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.881875 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:18.882086 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:18.882163 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:18.882362 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:01:18.882475 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:01:18.882561 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:18.882606 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 10:01:18.882628 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":106,"threads_started":1}
I20260808 10:01:18.884701 17438 raft_consensus.cc:1261] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659 [term 1 FOLLOWER]: Refusing update from remote peer dd2aed0446a24f8ab297fac5759612c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:01:18.884764 17221 raft_consensus.cc:1261] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb [term 1 FOLLOWER]: Refusing update from remote peer dd2aed0446a24f8ab297fac5759612c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:01:18.885149 17079 consensus_queue.cc:1035] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:01:18.885319 17536 consensus_queue.cc:1035] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:01:18.887707 17542 mvcc.cc:205] Tried to move back new op lower bound from 7316206710308958208 to 7316206710080294912. Current Snapshot: MvccSnapshot[applied={T|T < 7316206710308958208}]
I20260808 10:01:18.890105 16738 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:01:18.890215 16738 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:01:18.891131 16738 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Sending DeleteTablet for 3 replicas of tablet 9a05f4341e114f1f8eb5c3510050af66
I20260808 10:01:18.891500 16948 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a05f4341e114f1f8eb5c3510050af66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:01:18 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:55274
I20260808 10:01:18.891515 17407 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a05f4341e114f1f8eb5c3510050af66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:01:18 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:48552
I20260808 10:01:18.891772 17563 tablet_replica.cc:330] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659: stopping tablet replica
I20260808 10:01:18.891881 17563 raft_consensus.cc:2229] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:01:18.891929 17562 tablet_replica.cc:330] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9: stopping tablet replica
I20260808 10:01:18.891906 17188 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a05f4341e114f1f8eb5c3510050af66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:01:18 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:54910
I20260808 10:01:18.891980 17562 raft_consensus.cc:2229] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 10:01:18.891983 17563 raft_consensus.cc:2258] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:01:18.892079 17562 raft_consensus.cc:2258] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:01:18.892197 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 16812
I20260808 10:01:18.892552 17563 ts_tablet_manager.cc:1905] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:01:18.896555 17563 ts_tablet_manager.cc:1918] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:01:18.896641 17563 log.cc:1196] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/9a05f4341e114f1f8eb5c3510050af66
I20260808 10:01:18.897015 17563 ts_tablet_manager.cc:1939] T 9a05f4341e114f1f8eb5c3510050af66 P d9cff9effdf84ccd97f443e8f29e3659: Deleting consensus metadata
I20260808 10:01:18.899346 16716 catalog_manager.cc:4841] TS d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367): tablet 9a05f4341e114f1f8eb5c3510050af66 (table test-table [id=f7b47dc69cf445dfbefc63ce7328caf8]) successfully deleted
I20260808 10:01:18.903565 17565 tablet_replica.cc:330] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: stopping tablet replica
I20260808 10:01:18.903752 17565 raft_consensus.cc:2229] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:01:18.903908 17565 raft_consensus.cc:2258] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:01:18.904379 17565 ts_tablet_manager.cc:1905] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 10:01:18.905269 16717 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:42975 (error 108)
I20260808 10:01:18.905705 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 17074
I20260808 10:01:18.905890 17517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.905720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:42975 (local address 127.0.0.1:55288)
0808 10:01:18.905797 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:18.905846 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:42975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 10:01:18.908136 16717 catalog_manager.cc:4584] TS dd2aed0446a24f8ab297fac5759612c9 (127.24.71.193:42975): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9a05f4341e114f1f8eb5c3510050af66: Network error: Client connection negotiation failed: client connection to 127.24.71.193:42975: connect: Connection refused (error 111)
I20260808 10:01:18.915650 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 17301
I20260808 10:01:18.915822 17517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:18.915643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:41907 (local address 127.0.0.1:54924)
0808 10:01:18.915719 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:18.915778 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.194:41907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 10:01:18.929571 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 16683
I20260808 10:01:38.945758 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:35717
--webserver_interface=127.24.71.254
--webserver_port=37709
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:35717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:01:39.032533 17568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:39.032756 17568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:39.032780 17568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:39.034013 17568 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 10:01:39.034060 17568 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 10:01:39.034072 17568 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 10:01:39.034085 17568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:01:39.034097 17568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:39.034158 17568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:39.034176 17568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:01:39.034191 17568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:01:39.035815 17568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:35717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:35717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=37709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:39.036100 17568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:39.036355 17568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:39.041774 17577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:39.041846 17573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:39.041846 17575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:39.041853 17568 server_base.cc:1034] running on GCE node
I20260808 10:01:39.042342 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:39.042640 17568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:39.043792 17568 hybrid_clock.cc:648] HybridClock initialized: now 1786183299043769 us; error 42 us; skew 500 ppm
Aug 08 10:01:39 dist-test-slave-gw5c krb5kdc[15723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183299, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:39.050729 17568 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:01:39.051285 17568 webserver.cc:460] Webserver started at http://127.24.71.254:37709/ using document root <none> and password file <none>
I20260808 10:01:39.051630 17568 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:39.051715 17568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:39.053356 17568 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:01:39.054291 17591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:39.054531 17568 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:39.054656 17568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "3d46b6deac354c6d9b099aa764eca348"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "b4bd68b6488286758200d3d35f2b55e2"
server_key_iv: "e4ea452808db83a4c360395c940fdd79"
server_key_version: "encryptionkey@0"
I20260808 10:01:39.055050 17568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:39.069401 17568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:39.071687 17568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:39.071869 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:39.076341 17568 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:35717
I20260808 10:01:39.076380 17677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:35717 every 8 connection(s)
I20260808 10:01:39.076792 17568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:01:39.078373 17680 sys_catalog.cc:263] Verifying existing consensus state
I20260808 10:01:39.079038 17680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Bootstrap starting.
I20260808 10:01:39.082906 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 17568
I20260808 10:01:39.083207 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:42975
--local_ip_for_outbound_sockets=127.24.71.193
--tserver_master_addrs=127.24.71.254:35717
--webserver_port=43379
--webserver_interface=127.24.71.193
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:01:39.089566 17680 log.cc:824] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:39.092015 17680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 10:01:39.092355 17680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Bootstrap complete.
I20260808 10:01:39.094734 17680 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } }
I20260808 10:01:39.094967 17680 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d46b6deac354c6d9b099aa764eca348, State: Initialized, Role: FOLLOWER
I20260808 10:01:39.095142 17680 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } }
I20260808 10:01:39.095212 17680 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:01:39.095275 17680 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:01:39.095322 17680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 2 FOLLOWER]: Advancing to term 3
I20260808 10:01:39.096401 17680 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } }
I20260808 10:01:39.096524 17680 leader_election.cc:302] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d46b6deac354c6d9b099aa764eca348; no voters:
I20260808 10:01:39.096745 17680 leader_election.cc:288] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 10:01:39.096781 17688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 10:01:39.096903 17688 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [term 3 LEADER]: Becoming Leader. State: Replica: 3d46b6deac354c6d9b099aa764eca348, State: Running, Role: LEADER
I20260808 10:01:39.097061 17688 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } }
I20260808 10:01:39.097051 17680 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:01:39.097348 17691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d46b6deac354c6d9b099aa764eca348. Latest consensus state: current_term: 3 leader_uuid: "3d46b6deac354c6d9b099aa764eca348" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } } }
I20260808 10:01:39.097472 17691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: This master's current role is: LEADER
I20260808 10:01:39.097352 17690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "3d46b6deac354c6d9b099aa764eca348" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d46b6deac354c6d9b099aa764eca348" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35717 } } }
I20260808 10:01:39.097617 17690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348 [sys.catalog]: This master's current role is: LEADER
I20260808 10:01:39.097776 17693 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:01:39.098878 17693 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:01:39.099004 17693 catalog_manager.cc:1259] Loaded cluster ID: 9eb5b474bb36487db049a8c7b80d4e75
I20260808 10:01:39.099114 17693 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:01:39.100569 17693 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:01:39.100744 17693 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Loaded TSK: 0
I20260808 10:01:39.100802 17693 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3d46b6deac354c6d9b099aa764eca348: Loaded TSK: 1
F20260808 10:01:39.101083 17693 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f00aef079ad google::LogMessage::Fail() at ??:0
@ 0x7f00aef0a88a google::LogMessage::SendToLog() at ??:0
@ 0x7f00aef074de google::LogMessage::Flush() at ??:0
@ 0x7f00aef08a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f00b1674104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f00b1671d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f00b6e651cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f00b6e6548e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f00b6e65594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f00b6e2bc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f00b6e35ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f00b0dd50d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f00b0dca954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f00b1c2e6db start_thread at ??:0
@ 0x7f00ada0561f clone at ??:0
W20260808 10:01:39.192692 17685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:39.192912 17685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:39.192939 17685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:39.194152 17685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:39.194204 17685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:39.194233 17685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:01:39.195847 17685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:42975
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=43379
--tserver_master_addrs=127.24.71.254:35717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:39.196126 17685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:39.196408 17685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:39.201709 17749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:39.201731 17750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:39.201864 17752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:39.202069 17685 server_base.cc:1034] running on GCE node
I20260808 10:01:39.202355 17685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:39.202670 17685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:39.203866 17685 hybrid_clock.cc:648] HybridClock initialized: now 1786183299203842 us; error 37 us; skew 500 ppm
Aug 08 10:01:39 dist-test-slave-gw5c krb5kdc[15723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183299, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:39.207168 17685 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 10:01:39.207778 17685 webserver.cc:460] Webserver started at http://127.24.71.193:43379/ using document root <none> and password file <none>
I20260808 10:01:39.208066 17685 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:39.208140 17685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:39.210059 17685 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:01:39.210841 17761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:39.211082 17685 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:39.211198 17685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "dd2aed0446a24f8ab297fac5759612c9"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "7b99934e331a335368b34a3cf6467dfd"
server_key_iv: "045737c38e93f21ea47f353268155d73"
server_key_version: "encryptionkey@0"
I20260808 10:01:39.211642 17685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:39.221827 17685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:39.224062 17685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:39.224228 17685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:39.224480 17685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:39.224965 17771 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 10:01:39.227035 17685 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 10:01:39.227108 17685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 10:01:39.227155 17685 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 10:01:39.227896 17685 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 10:01:39.227952 17685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 10:01:39.228044 17771 tablet_bootstrap.cc:492] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9: Bootstrap starting.
I20260808 10:01:39.235889 17685 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:42975
I20260808 10:01:39.235978 17957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:42975 every 8 connection(s)
I20260808 10:01:39.236338 17685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 10:01:39.240326 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 17685
I20260808 10:01:39.240641 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:41907
--local_ip_for_outbound_sockets=127.24.71.194
--tserver_master_addrs=127.24.71.254:35717
--webserver_port=46413
--webserver_interface=127.24.71.194
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:01:39.241035 17771 log.cc:824] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:39.244134 17771 tablet_bootstrap.cc:492] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 10:01:39.244490 17771 tablet_bootstrap.cc:492] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9: Bootstrap complete.
I20260808 10:01:39.245963 17771 ts_tablet_manager.cc:1397] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.013s
I20260808 10:01:39.247553 17771 raft_consensus.cc:348] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:39.247921 17771 raft_consensus.cc:729] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2aed0446a24f8ab297fac5759612c9, State: Initialized, Role: FOLLOWER
I20260808 10:01:39.248121 17771 consensus_queue.cc:260] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:39.248446 17771 ts_tablet_manager.cc:1428] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
W20260808 10:01:39.317965 17962 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:01:39.237065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:52977)
0808 10:01:39.239514 (+ 2449us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:39.239563 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:39.240065 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:39.317728 (+ 77663us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":2402,"thread_start_us":77,"threads_started":1}
W20260808 10:01:39.318252 17960 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:35717 (0 consecutive failures): Network error: Failed to ping master at 127.24.71.254:35717: Client connection negotiation failed: client connection to 127.24.71.254:35717: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 10:01:39.318670 17962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:39.318516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:59107)
0808 10:01:39.318589 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:39.318640 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 10:01:39.319061 17962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:39.318932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:59933)
0808 10:01:39.319000 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:39.319036 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 10:01:39.319195 17960 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 10:01:39.332556 17967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:39.332779 17967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:39.332804 17967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:39.333911 17967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:39.333948 17967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:39.333974 17967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:01:39.335520 17967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:41907
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=46413
--tserver_master_addrs=127.24.71.254:35717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:39.335744 17967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:39.335924 17967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:39.341351 17980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:39.341436 17977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:39.341518 17967 server_base.cc:1034] running on GCE node
W20260808 10:01:39.341351 17975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:39.341820 17967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:39.342029 17967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:39.343170 17967 hybrid_clock.cc:648] HybridClock initialized: now 1786183299343153 us; error 42 us; skew 500 ppm
Aug 08 10:01:39 dist-test-slave-gw5c krb5kdc[15723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183299, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:39.345841 17967 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 10:01:39.346287 17967 webserver.cc:460] Webserver started at http://127.24.71.194:46413/ using document root <none> and password file <none>
I20260808 10:01:39.346503 17967 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:39.346546 17967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:39.347985 17967 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:01:39.348702 17990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:39.348908 17967 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:01:39.348996 17967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "4e24c931395a497bba05a3d72e24c5fb"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "c08d5d65ec6b70a729cf3c16e30bbfa7"
server_key_iv: "dbf30b39a914d38e04604a36e43c6556"
server_key_version: "encryptionkey@0"
I20260808 10:01:39.349325 17967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:39.388959 17967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:39.391559 17967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:39.391685 17967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:39.391904 17967 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:39.392307 18006 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260808 10:01:39.393782 18006 ts_tablet_manager.cc:1852] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 10:01:39.394079 18006 ts_tablet_manager.cc:1905] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:01:39.396358 18006 ts_tablet_manager.cc:1918] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:01:39.396507 18006 log.cc:1196] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/9a05f4341e114f1f8eb5c3510050af66
I20260808 10:01:39.396867 18006 ts_tablet_manager.cc:1939] T 9a05f4341e114f1f8eb5c3510050af66 P 4e24c931395a497bba05a3d72e24c5fb: Deleting consensus metadata
I20260808 10:01:39.397104 17967 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 10:01:39.397150 17967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260808 10:01:39.397176 17967 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:01:39.397189 17967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:39.403630 17967 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:41907
I20260808 10:01:39.403692 18180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:41907 every 8 connection(s)
I20260808 10:01:39.404012 17967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 10:01:39.405076 18185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:39.404684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:33099)
0808 10:01:39.404861 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:39.404938 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
W20260808 10:01:39.405333 18183 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:35717 (0 consecutive failures): Network error: Failed to ping master at 127.24.71.254:35717: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
I20260808 10:01:39.405640 18185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:39.405550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:40965)
0808 10:01:39.405596 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:39.405623 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 10:01:39.405923 18185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:39.405849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:37589)
0808 10:01:39.405888 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:39.405910 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 10:01:39.406050 18183 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 10:01:39.408419 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 17967
I20260808 10:01:39.408681 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:33367
--local_ip_for_outbound_sockets=127.24.71.195
--tserver_master_addrs=127.24.71.254:35717
--webserver_port=33861
--webserver_interface=127.24.71.195
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:37227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:01:39.494436 18191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:39.494658 18191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:39.494683 18191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:39.495810 18191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:39.495849 18191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:39.495874 18191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:01:39.497311 18191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:37227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:33367
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=33861
--tserver_master_addrs=127.24.71.254:35717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:39.497521 18191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:39.497700 18191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:39.503002 18198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:39.503023 18204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:39.503017 18202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:39.503109 18191 server_base.cc:1034] running on GCE node
I20260808 10:01:39.503510 18191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:39.503780 18191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:39.504925 18191 hybrid_clock.cc:648] HybridClock initialized: now 1786183299504912 us; error 37 us; skew 500 ppm
Aug 08 10:01:39 dist-test-slave-gw5c krb5kdc[15723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183299, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:39.507706 18191 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 10:01:39.508208 18191 webserver.cc:460] Webserver started at http://127.24.71.195:33861/ using document root <none> and password file <none>
I20260808 10:01:39.508493 18191 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:39.508569 18191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:39.509981 18191 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:01:39.510615 18216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:39.510798 18191 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:01:39.510907 18191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "d9cff9effdf84ccd97f443e8f29e3659"
format_stamp: "Formatted at 2026-08-08 10:00:57 on dist-test-slave-gw5c"
server_key: "e65c8d41ad12b584b5cbc76d4592ee91"
server_key_iv: "a453c70af5412126993ff43809616795"
server_key_version: "encryptionkey@0"
I20260808 10:01:39.511286 18191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:39.525033 18191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:39.527098 18191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:39.527283 18191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:39.527570 18191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:39.527905 18191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:01:39.527962 18191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:39.528007 18191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:01:39.528061 18191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:39.534106 18191 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:33367
I20260808 10:01:39.534157 18389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:33367 every 8 connection(s)
I20260808 10:01:39.534523 18191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 10:01:39.534700 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 18191
I20260808 10:01:39.535835 18396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:39.535359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:60405)
0808 10:01:39.535587 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:39.535670 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":124,"threads_started":1}
W20260808 10:01:39.536309 18391 heartbeater.cc:644] Failed to heartbeat to 127.24.71.254:35717 (0 consecutive failures): Network error: Failed to ping master at 127.24.71.254:35717: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
I20260808 10:01:39.536618 18396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:39.536520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:54199)
0808 10:01:39.536573 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:39.536599 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 10:01:39.536914 18396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:39.536823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:36403)
0808 10:01:39.536878 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:39.536900 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 10:01:39.537056 18391 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 10:01:40.319798 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:40.319569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:54631)
0808 10:01:40.319695 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:40.319732 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260808 10:01:40.406616 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:40.406419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:60507)
0808 10:01:40.406540 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:40.406579 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
I20260808 10:01:40.537663 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:40.537446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:36175)
0808 10:01:40.537565 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:40.537608 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":57,"threads_started":1}
I20260808 10:01:40.672019 18402 raft_consensus.cc:482] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:01:40.672164 18402 raft_consensus.cc:504] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:40.672497 18402 leader_election.cc:288] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907), d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367)
Aug 08 10:01:40 dist-test-slave-gw5c krb5kdc[15723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183299, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.195@KRBTEST.COM
Aug 08 10:01:40 dist-test-slave-gw5c krb5kdc[15723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183299, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.194@KRBTEST.COM
I20260808 10:01:40.686064 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:40.672663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:41907 (local address 127.24.71.193:48025)
0808 10:01:40.672727 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:40.672739 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:40.672798 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:40.673918 (+ 1120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:40.673922 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:40.674497 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:40.674788 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:40.674796 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:40.676502 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:40.676503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:40.677825 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:40.677828 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:40.678666 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:40.678667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:40.678805 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:40.679493 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:01:40.679502 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:40.681867 (+ 2365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:40.684115 (+ 2248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:40.684127 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:40.684129 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:40.684606 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:40.685032 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:40.685033 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:40.685033 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:40.685084 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:40.685533 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:40.685540 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:40.685659 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 10:01:40.685760 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 10:01:40.685932 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":98}
I20260808 10:01:40.686136 18406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:40.672791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:48025 (local address 127.24.71.194:41907)
0808 10:01:40.672943 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:40.672957 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:40.672983 (+ 26us) server_negotiation.cc:407] Connection header received
0808 10:01:40.673660 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:40.673663 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:40.673722 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:40.673844 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:40.674920 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:40.676396 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:40.677938 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:40.678561 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:40.678679 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:40.681995 (+ 3316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:40.682000 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:40.682000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:40.682014 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:40.684041 (+ 2027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:40.684707 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:40.684710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:40.684711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:40.684839 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:40.685161 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:40.685162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:40.685163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:40.685466 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:40.685534 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:40.685849 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 10:01:40.686001 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260808 10:01:40.686347 18407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:40.672829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:33323 (local address 127.24.71.195:33367)
0808 10:01:40.673010 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:40.673018 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:40.673049 (+ 31us) server_negotiation.cc:407] Connection header received
0808 10:01:40.673586 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:40.673589 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:40.673651 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:40.673810 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:40.674923 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:40.676380 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:40.677922 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:40.678561 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:40.678679 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:40.681687 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:40.681691 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:40.681691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:40.681704 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:40.684005 (+ 2301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:40.684706 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:40.684710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:40.684711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:40.684839 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:40.685564 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:40.685565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:40.685565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:40.685834 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:40.685921 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:40.686112 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 10:01:40.686252 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":83,"threads_started":1}
I20260808 10:01:40.686244 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:40.672664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:33367 (local address 127.24.71.193:33323)
0808 10:01:40.672821 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:40.672831 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:40.672904 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:40.673918 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:40.673922 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:40.674499 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:40.674788 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:40.674796 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:40.676504 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:40.676505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:40.677825 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:40.677828 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:40.678668 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:40.678669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:40.678805 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:40.679573 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:01:40.679577 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:40.681456 (+ 1879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:40.684115 (+ 2659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:40.684127 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:40.684129 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:40.684606 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:40.684923 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:40.684924 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:40.684924 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:40.685082 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:40.685919 (+ 837us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:40.685920 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:40.685958 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 10:01:40.686031 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 10:01:40.686127 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":94,"thread_start_us":64,"threads_started":1}
W20260808 10:01:40.687665 17767 leader_election.cc:341] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367): Not found: Tablet not found: 9a05f4341e114f1f8eb5c3510050af66
W20260808 10:01:40.687816 17765 leader_election.cc:341] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907): Not found: Tablet not found: 9a05f4341e114f1f8eb5c3510050af66
I20260808 10:01:40.687880 17765 leader_election.cc:302] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd2aed0446a24f8ab297fac5759612c9; no voters: 4e24c931395a497bba05a3d72e24c5fb, d9cff9effdf84ccd97f443e8f29e3659
I20260808 10:01:40.688004 18402 raft_consensus.cc:2726] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 10:01:41.320554 18409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:41.320314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:53447)
0808 10:01:41.320458 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:41.320503 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":102,"threads_started":1}
I20260808 10:01:41.407370 18412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:41.407117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:44409)
0808 10:01:41.407267 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:41.407311 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
I20260808 10:01:41.538350 18417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:41.538120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:36235)
0808 10:01:41.538263 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:41.538300 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
I20260808 10:01:42.321326 18418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:42.321049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:47681)
0808 10:01:42.321216 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:42.321263 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":80,"threads_started":1}
I20260808 10:01:42.408135 18420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:42.407909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:51499)
0808 10:01:42.408049 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:42.408091 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":65,"threads_started":1}
I20260808 10:01:42.539081 18422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:42.538824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:55593)
0808 10:01:42.539005 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:42.539041 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":78,"threads_started":1}
I20260808 10:01:42.790148 18423 raft_consensus.cc:482] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:01:42.790308 18423 raft_consensus.cc:504] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:42.790575 18423 leader_election.cc:288] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907), d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367)
W20260808 10:01:42.791056 17767 leader_election.cc:341] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367): Not found: Tablet not found: 9a05f4341e114f1f8eb5c3510050af66
W20260808 10:01:42.791153 17765 leader_election.cc:341] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907): Not found: Tablet not found: 9a05f4341e114f1f8eb5c3510050af66
I20260808 10:01:42.791261 17765 leader_election.cc:302] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd2aed0446a24f8ab297fac5759612c9; no voters: 4e24c931395a497bba05a3d72e24c5fb, d9cff9effdf84ccd97f443e8f29e3659
I20260808 10:01:42.791347 18423 raft_consensus.cc:2726] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 10:01:43.322214 18424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:43.321921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:59207)
0808 10:01:43.322099 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:43.322163 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":71,"threads_started":1}
I20260808 10:01:43.408951 18426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:43.408714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:48439)
0808 10:01:43.408867 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:43.408904 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":79,"threads_started":1}
I20260808 10:01:43.539867 18428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:43.539649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:57313)
0808 10:01:43.539780 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:43.539822 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":64,"threads_started":1}
I20260808 10:01:44.323031 18430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:44.322801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:35959)
0808 10:01:44.322943 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:44.322984 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":77,"threads_started":1}
I20260808 10:01:44.409788 18432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:44.409524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:48457)
0808 10:01:44.409671 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:44.409716 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":70,"threads_started":1}
I20260808 10:01:44.540737 18435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:44.540482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:51171)
0808 10:01:44.540640 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:44.540691 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":81,"threads_started":1}
I20260808 10:01:45.323814 18436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:45.323584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:39385)
0808 10:01:45.323724 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:45.323764 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260808 10:01:45.410604 18440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:45.410374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:42711)
0808 10:01:45.410515 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:45.410557 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":70,"threads_started":1}
I20260808 10:01:45.489979 18441 raft_consensus.cc:482] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:01:45.490087 18441 raft_consensus.cc:504] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:45.490278 18441 leader_election.cc:288] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907), d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367)
W20260808 10:01:45.490708 17765 leader_election.cc:341] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907): Not found: Tablet not found: 9a05f4341e114f1f8eb5c3510050af66
W20260808 10:01:45.490813 17767 leader_election.cc:341] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367): Not found: Tablet not found: 9a05f4341e114f1f8eb5c3510050af66
I20260808 10:01:45.490917 17767 leader_election.cc:302] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd2aed0446a24f8ab297fac5759612c9; no voters: 4e24c931395a497bba05a3d72e24c5fb, d9cff9effdf84ccd97f443e8f29e3659
I20260808 10:01:45.490993 18441 raft_consensus.cc:2726] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 10:01:45.541697 18443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:45.541463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:57497)
0808 10:01:45.541613 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:45.541652 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":85,"threads_started":1}
I20260808 10:01:46.324692 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:46.324411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:43169)
0808 10:01:46.324582 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:46.324617 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":109,"threads_started":1}
I20260808 10:01:46.411432 18446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:46.411110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:43477)
0808 10:01:46.411295 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:46.411336 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":94,"threads_started":1}
I20260808 10:01:46.542577 18447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:46.542275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:55969)
0808 10:01:46.542472 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:46.542523 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":85,"threads_started":1}
I20260808 10:01:47.325479 18449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:47.325229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:39707)
0808 10:01:47.325378 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:47.325429 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":73,"threads_started":1}
I20260808 10:01:47.412287 18450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:47.411958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:47847)
0808 10:01:47.412154 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:47.412209 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":84,"threads_started":1}
I20260808 10:01:47.543653 18451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:47.543194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:57465)
0808 10:01:47.543373 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:47.543598 (+ 225us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":92,"threads_started":1}
I20260808 10:01:48.326234 18453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:48.325974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:35411)
0808 10:01:48.326140 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:48.326184 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":68,"threads_started":1}
I20260808 10:01:48.412997 18455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:48.412739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:40253)
0808 10:01:48.412913 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:48.412951 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":94,"threads_started":1}
I20260808 10:01:48.544528 18456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:48.544291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:50407)
0808 10:01:48.544430 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:48.544478 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
I20260808 10:01:49.327215 18457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:49.327001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:50111)
0808 10:01:49.327136 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:49.327165 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":84,"threads_started":1}
I20260808 10:01:49.413694 18458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:49.413436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:54511)
0808 10:01:49.413599 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:49.413648 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":65,"threads_started":1}
I20260808 10:01:49.497308 18459 raft_consensus.cc:482] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:01:49.497411 18459 raft_consensus.cc:504] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:49.497573 18459 leader_election.cc:288] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907), d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367)
W20260808 10:01:49.497954 17765 leader_election.cc:341] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907): Not found: Tablet not found: 9a05f4341e114f1f8eb5c3510050af66
W20260808 10:01:49.498061 17767 leader_election.cc:341] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367): Not found: Tablet not found: 9a05f4341e114f1f8eb5c3510050af66
I20260808 10:01:49.498148 17767 leader_election.cc:302] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd2aed0446a24f8ab297fac5759612c9; no voters: 4e24c931395a497bba05a3d72e24c5fb, d9cff9effdf84ccd97f443e8f29e3659
I20260808 10:01:49.498231 18459 raft_consensus.cc:2726] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 10:01:49.545284 18462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:49.545054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:44837)
0808 10:01:49.545192 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:49.545235 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":70,"threads_started":1}
I20260808 10:01:50.327889 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:50.327647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:39755)
0808 10:01:50.327793 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:50.327837 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":86,"threads_started":1}
I20260808 10:01:50.414526 18465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:50.414267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:36847)
0808 10:01:50.414391 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:50.414462 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":68,"threads_started":1}
I20260808 10:01:50.546030 18467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:50.545773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:35241)
0808 10:01:50.545939 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:50.545984 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":83,"threads_started":1}
I20260808 10:01:51.328671 18469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:51.328437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:40717)
0808 10:01:51.328572 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:51.328619 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":71,"threads_started":1}
I20260808 10:01:51.415481 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:51.415122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:35621)
0808 10:01:51.415338 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:51.415430 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":78,"threads_started":1}
I20260808 10:01:51.546854 18472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:51.546603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:38649)
0808 10:01:51.546756 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:51.546806 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":82,"threads_started":1}
I20260808 10:01:52.329495 18473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:52.329230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:38409)
0808 10:01:52.329391 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:52.329445 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":69,"threads_started":1}
I20260808 10:01:52.416204 18474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:52.415936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:60263)
0808 10:01:52.416108 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:52.416156 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":81,"threads_started":1}
I20260808 10:01:52.547636 18476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:52.547356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:42969)
0808 10:01:52.547537 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:52.547583 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":101,"threads_started":1}
I20260808 10:01:53.330318 18477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:53.330049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:49755)
0808 10:01:53.330208 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:53.330264 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":72,"threads_started":1}
I20260808 10:01:53.416965 18478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:53.416715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:37145)
0808 10:01:53.416869 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:53.416915 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":82,"threads_started":1}
I20260808 10:01:53.548476 18480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:53.548209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:48167)
0808 10:01:53.548374 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:53.548424 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260808 10:01:54.156934 18481 raft_consensus.cc:482] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:01:54.157049 18481 raft_consensus.cc:504] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e24c931395a497bba05a3d72e24c5fb" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 41907 } } peers { permanent_uuid: "d9cff9effdf84ccd97f443e8f29e3659" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 33367 } } peers { permanent_uuid: "dd2aed0446a24f8ab297fac5759612c9" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42975 } }
I20260808 10:01:54.157351 18481 leader_election.cc:288] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907), d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367)
W20260808 10:01:54.157783 17767 leader_election.cc:341] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d9cff9effdf84ccd97f443e8f29e3659 (127.24.71.195:33367): Not found: Tablet not found: 9a05f4341e114f1f8eb5c3510050af66
W20260808 10:01:54.157861 17765 leader_election.cc:341] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4e24c931395a497bba05a3d72e24c5fb (127.24.71.194:41907): Not found: Tablet not found: 9a05f4341e114f1f8eb5c3510050af66
I20260808 10:01:54.157953 17765 leader_election.cc:302] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd2aed0446a24f8ab297fac5759612c9; no voters: 4e24c931395a497bba05a3d72e24c5fb, d9cff9effdf84ccd97f443e8f29e3659
I20260808 10:01:54.158046 18481 raft_consensus.cc:2726] T 9a05f4341e114f1f8eb5c3510050af66 P dd2aed0446a24f8ab297fac5759612c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 10:01:54.331226 18484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:54.330973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.193:35989)
0808 10:01:54.331133 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:54.331178 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":84,"threads_started":1}
I20260808 10:01:54.417891 18485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:54.417585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.194:33099)
0808 10:01:54.417718 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:54.417841 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":73,"threads_started":1}
I20260808 10:01:54.535768 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 17685
I20260808 10:01:54.549414 18486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:54.549149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35717 (local address 127.24.71.195:50757)
0808 10:01:54.549310 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:54.549356 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.254:35717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
I20260808 10:01:54.550645 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 17967
I20260808 10:01:54.559366 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 18191
2026-08-08T10:01:54Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58919 ms)
[----------] 30 tests from SecurityITest (246315 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:01:54 dist-test-slave-gw5c krb5kdc[18490](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:01:54 dist-test-slave-gw5c krb5kdc[18490](info): set up 2 sockets
Aug 08 10:01:54 dist-test-slave-gw5c krb5kdc[18490](info): commencing operation
krb5kdc: starting...
W20260808 10:01:55.826311 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:01:55 dist-test-slave-gw5c krb5kdc[18490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:01:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:01:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:01:55.954710 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33735
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:40067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:33735
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:01:56.039583 18512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:56.039798 18512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:56.039821 18512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:56.041034 18512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:01:56.041081 18512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:56.041096 18512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:56.041109 18512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:01:56.041121 18512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:01:56.042625 18512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:40067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:33735
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:56.042891 18512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:56.043148 18512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 10:01:56.048513 18512 server_base.cc:1034] running on GCE node
W20260808 10:01:56.048667 18522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:56.048708 18524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:56.048681 18520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:56.049134 18512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:56.049459 18512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:56.050645 18512 hybrid_clock.cc:648] HybridClock initialized: now 1786183316050639 us; error 37 us; skew 500 ppm
Aug 08 10:01:56 dist-test-slave-gw5c krb5kdc[18490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183316, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:56.053345 18512 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:01:56.053887 18512 webserver.cc:460] Webserver started at http://127.24.71.254:42059/ using document root <none> and password file <none>
I20260808 10:01:56.054126 18512 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:56.054191 18512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:56.054349 18512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:01:56.055567 18512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "3c288ae8ca3f468ab64318a34e116349"
format_stamp: "Formatted at 2026-08-08 10:01:56 on dist-test-slave-gw5c"
server_key: "6071d56afec4c1eadf76508f60555e6c"
server_key_iv: "e4acf6c35839a3fc4e5d5280ca954492"
server_key_version: "encryptionkey@0"
I20260808 10:01:56.055956 18512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "3c288ae8ca3f468ab64318a34e116349"
format_stamp: "Formatted at 2026-08-08 10:01:56 on dist-test-slave-gw5c"
server_key: "6071d56afec4c1eadf76508f60555e6c"
server_key_iv: "e4acf6c35839a3fc4e5d5280ca954492"
server_key_version: "encryptionkey@0"
I20260808 10:01:56.057354 18512 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:01:56.058102 18535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:56.058377 18512 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:56.058482 18512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "3c288ae8ca3f468ab64318a34e116349"
format_stamp: "Formatted at 2026-08-08 10:01:56 on dist-test-slave-gw5c"
server_key: "6071d56afec4c1eadf76508f60555e6c"
server_key_iv: "e4acf6c35839a3fc4e5d5280ca954492"
server_key_version: "encryptionkey@0"
I20260808 10:01:56.058554 18512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:56.079574 18512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:56.081631 18512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:56.081816 18512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:56.086649 18512 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:33735
I20260808 10:01:56.086685 18612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:33735 every 8 connection(s)
I20260808 10:01:56.087116 18512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:01:56.088171 18614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:56.090512 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 18512
I20260808 10:01:56.090617 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:01:56.090619 18614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349: Bootstrap starting.
I20260808 10:01:56.090837 24863 external_mini_cluster.cc:1428] Setting key 4a5bff40d4eeebc0f55c7aa54a7f7446
I20260808 10:01:56.091441 18614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:56.091864 18614 log.cc:824] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:56.092737 18614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349: No bootstrap required, opened a new log
I20260808 10:01:56.095182 18614 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c288ae8ca3f468ab64318a34e116349" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33735 } }
I20260808 10:01:56.095328 18614 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:56.095352 18614 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c288ae8ca3f468ab64318a34e116349, State: Initialized, Role: FOLLOWER
I20260808 10:01:56.095515 18614 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c288ae8ca3f468ab64318a34e116349" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33735 } }
I20260808 10:01:56.095605 18614 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:01:56.095695 18614 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:01:56.095767 18614 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:56.096375 18614 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c288ae8ca3f468ab64318a34e116349" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33735 } }
I20260808 10:01:56.096499 18614 leader_election.cc:302] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c288ae8ca3f468ab64318a34e116349; no voters:
I20260808 10:01:56.096671 18614 leader_election.cc:288] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:01:56.096704 18622 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:01:56.096930 18622 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [term 1 LEADER]: Becoming Leader. State: Replica: 3c288ae8ca3f468ab64318a34e116349, State: Running, Role: LEADER
I20260808 10:01:56.096985 18614 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:01:56.097129 18622 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c288ae8ca3f468ab64318a34e116349" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33735 } }
I20260808 10:01:56.097565 18623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c288ae8ca3f468ab64318a34e116349" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c288ae8ca3f468ab64318a34e116349" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33735 } } }
I20260808 10:01:56.097553 18622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c288ae8ca3f468ab64318a34e116349. Latest consensus state: current_term: 1 leader_uuid: "3c288ae8ca3f468ab64318a34e116349" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c288ae8ca3f468ab64318a34e116349" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33735 } } }
I20260808 10:01:56.097651 18623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [sys.catalog]: This master's current role is: LEADER
I20260808 10:01:56.097658 18622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349 [sys.catalog]: This master's current role is: LEADER
I20260808 10:01:56.098573 18632 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 08 10:01:56 dist-test-slave-gw5c krb5kdc[18490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:01:56.099160 18632 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:01:56.101547 18632 catalog_manager.cc:1347] Generated new cluster ID: ba12f6d449764b40822265beda371b5d
I20260808 10:01:56.101603 18632 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:01:56.103308 18619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.091459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39126 (local address 127.24.71.254:33735)
0808 10:01:56.091668 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:56.091680 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:56.091720 (+ 40us) server_negotiation.cc:407] Connection header received
0808 10:01:56.092322 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:56.092330 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:56.092414 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:56.092565 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:56.093248 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.094729 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.095667 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.096185 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.096312 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.099541 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:56.099545 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:56.099545 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:56.099558 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:56.101398 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:56.101813 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:56.101816 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:56.101816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:56.101916 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:56.102112 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:56.102113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:56.102113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:56.102391 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:56.102538 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:56.102967 (+ 429us) server_negotiation.cc:299] Negotiation successful
0808 10:01:56.103100 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":84,"threads_started":1}
I20260808 10:01:56.110895 18632 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:01:56.111536 18632 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:01:56.119362 18632 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349: Generated new TSK 0
I20260808 10:01:56.119613 18632 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 10:01:56.147008 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33735
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:40067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:01:56.232165 18654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:56.232383 18654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:56.232417 18654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:56.233560 18654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:56.233598 18654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:56.233625 18654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:01:56.235025 18654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:40067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:56.235219 18654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:56.235493 18654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:56.240608 18664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:56.240639 18661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:56.240649 18662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:56.240782 18654 server_base.cc:1034] running on GCE node
I20260808 10:01:56.240998 18654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:56.241194 18654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:56.242328 18654 hybrid_clock.cc:648] HybridClock initialized: now 1786183316242317 us; error 29 us; skew 500 ppm
Aug 08 10:01:56 dist-test-slave-gw5c krb5kdc[18490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183316, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:56.245014 18654 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 10:01:56.245460 18654 webserver.cc:460] Webserver started at http://127.24.71.193:42353/ using document root <none> and password file <none>
I20260808 10:01:56.245682 18654 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:56.245726 18654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:56.245891 18654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:01:56.246950 18654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "1652b44d88fd4e8a8bf05d3f77e721a1"
format_stamp: "Formatted at 2026-08-08 10:01:56 on dist-test-slave-gw5c"
server_key: "180417603319d000eb1d6c18f8c86226"
server_key_iv: "ea35360ad0f96e4a053932205db92976"
server_key_version: "encryptionkey@0"
I20260808 10:01:56.247309 18654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "1652b44d88fd4e8a8bf05d3f77e721a1"
format_stamp: "Formatted at 2026-08-08 10:01:56 on dist-test-slave-gw5c"
server_key: "180417603319d000eb1d6c18f8c86226"
server_key_iv: "ea35360ad0f96e4a053932205db92976"
server_key_version: "encryptionkey@0"
I20260808 10:01:56.248695 18654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:01:56.249387 18675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:56.249567 18654 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:56.249655 18654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "1652b44d88fd4e8a8bf05d3f77e721a1"
format_stamp: "Formatted at 2026-08-08 10:01:56 on dist-test-slave-gw5c"
server_key: "180417603319d000eb1d6c18f8c86226"
server_key_iv: "ea35360ad0f96e4a053932205db92976"
server_key_version: "encryptionkey@0"
I20260808 10:01:56.249727 18654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:56.261058 18654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:56.263656 18654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:56.263823 18654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:56.264070 18654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:56.264421 18654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:01:56.264467 18654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:56.264505 18654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:01:56.264533 18654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:56.270542 18654 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:36327
I20260808 10:01:56.270619 18871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:36327 every 8 connection(s)
I20260808 10:01:56.270972 18654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 10:01:56.272789 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 18654
I20260808 10:01:56.272903 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 10:01:56.273094 24863 external_mini_cluster.cc:1428] Setting key 322e3d4a1933fa2ac1374632d2e2480c
Aug 08 10:01:56 dist-test-slave-gw5c krb5kdc[18490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183316, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:01:56.281581 18619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.271789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:38663 (local address 127.24.71.254:33735)
0808 10:01:56.271860 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:56.271862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:56.272069 (+ 207us) server_negotiation.cc:407] Connection header received
0808 10:01:56.272585 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:56.272587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:56.272601 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:56.272686 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:56.273799 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.274310 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.275339 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.275628 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.275704 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.278318 (+ 2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:56.278320 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:56.278321 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:56.278332 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:56.280108 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:56.280559 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:56.280561 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:56.280561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:56.280628 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:56.280889 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:56.280890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:56.280890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:56.281015 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:56.281090 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:56.281379 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 10:01:56.281474 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 10:01:56.281792 18878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.271748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33735 (local address 127.24.71.193:38663)
0808 10:01:56.271921 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:56.271977 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:56.272474 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:56.272760 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:56.272763 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:56.273477 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:56.273689 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.273694 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.274410 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.274411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.275240 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.275242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.275714 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.275715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.275855 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.276423 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:01:56.276433 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:56.278170 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:56.280217 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:56.280226 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:56.280228 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:56.280479 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:56.280693 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:56.280694 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:56.280695 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:56.280818 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:56.281079 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:56.281087 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:56.281238 (+ 151us) client_negotiation.cc:769] Sending connection context
0808 10:01:56.281345 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 10:01:56.281520 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
I20260808 10:01:56.282326 18873 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33735
I20260808 10:01:56.282452 18873 heartbeater.cc:464] Registering TS with master...
I20260808 10:01:56.282680 18873 heartbeater.cc:511] Master 127.24.71.254:33735 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
I20260808 10:01:56.283280 18561 ts_manager.cc:194] Registered new tserver with Master: 1652b44d88fd4e8a8bf05d3f77e721a1 (127.24.71.193:36327)
I20260808 10:01:56.283986 18561 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:38663
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 10:01:56.303464 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33735
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:40067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:01:56.391367 18884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:56.391616 18884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:56.391644 18884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:56.392778 18884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:56.392817 18884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:56.392844 18884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:01:56.394292 18884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:40067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:56.394490 18884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:56.394675 18884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:56.400290 18892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:56.400346 18891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:56.400494 18884 server_base.cc:1034] running on GCE node
W20260808 10:01:56.400363 18897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:56.400774 18884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:56.400990 18884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:56.402136 18884 hybrid_clock.cc:648] HybridClock initialized: now 1786183316402114 us; error 39 us; skew 500 ppm
Aug 08 10:01:56 dist-test-slave-gw5c krb5kdc[18490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183316, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:56.404886 18884 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 10:01:56.405349 18884 webserver.cc:460] Webserver started at http://127.24.71.194:46875/ using document root <none> and password file <none>
I20260808 10:01:56.405582 18884 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:56.405632 18884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:56.405786 18884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:01:56.406924 18884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "3499bfd15e0b4b3091e202880a8a7f97"
format_stamp: "Formatted at 2026-08-08 10:01:56 on dist-test-slave-gw5c"
server_key: "855d69afb5e7dbf240b3edb363f4adc4"
server_key_iv: "5cdb2249c5c9a519ee251275dfd801ce"
server_key_version: "encryptionkey@0"
I20260808 10:01:56.407312 18884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "3499bfd15e0b4b3091e202880a8a7f97"
format_stamp: "Formatted at 2026-08-08 10:01:56 on dist-test-slave-gw5c"
server_key: "855d69afb5e7dbf240b3edb363f4adc4"
server_key_iv: "5cdb2249c5c9a519ee251275dfd801ce"
server_key_version: "encryptionkey@0"
I20260808 10:01:56.408774 18884 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:01:56.409641 18915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:56.409806 18884 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 10:01:56.409907 18884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "3499bfd15e0b4b3091e202880a8a7f97"
format_stamp: "Formatted at 2026-08-08 10:01:56 on dist-test-slave-gw5c"
server_key: "855d69afb5e7dbf240b3edb363f4adc4"
server_key_iv: "5cdb2249c5c9a519ee251275dfd801ce"
server_key_version: "encryptionkey@0"
I20260808 10:01:56.409968 18884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:56.427074 18884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:56.429139 18884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:56.429267 18884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:56.429479 18884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:56.429754 18884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:01:56.429786 18884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:56.429809 18884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:01:56.429822 18884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:56.436012 18884 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:38871
I20260808 10:01:56.436106 19112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:38871 every 8 connection(s)
I20260808 10:01:56.436431 18884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 10:01:56.440135 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 18884
I20260808 10:01:56.440265 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 10:01:56.440475 24863 external_mini_cluster.cc:1428] Setting key af7743859fcdf1d86a99c79949de87ee
Aug 08 10:01:56 dist-test-slave-gw5c krb5kdc[18490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183316, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:01:56.447166 18619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.437221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:58207 (local address 127.24.71.254:33735)
0808 10:01:56.437281 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:56.437283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:56.437511 (+ 228us) server_negotiation.cc:407] Connection header received
0808 10:01:56.438078 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:56.438080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:56.438094 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:56.438148 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:56.439160 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.439730 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.441094 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.441293 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.441379 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.443803 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:56.443805 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:56.443805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:56.443813 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:56.445618 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:56.446084 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:56.446085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:56.446086 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:56.446154 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:56.446400 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:56.446402 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:56.446402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:56.446573 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:56.446648 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:56.446921 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 10:01:56.447024 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 10:01:56.447186 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.437182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33735 (local address 127.24.71.194:58207)
0808 10:01:56.437380 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:56.437427 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:56.437962 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:56.438220 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:56.438224 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:56.438831 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:56.439058 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.439062 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.439827 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.439828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.441000 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.441003 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.441392 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.441393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.441527 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.442068 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:01:56.442076 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:56.443695 (+ 1619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:56.445738 (+ 2043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:56.445747 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:56.445749 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:56.446004 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:56.446225 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:56.446225 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:56.446225 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:56.446332 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:56.446648 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:56.446653 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:56.446780 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 10:01:56.446863 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 10:01:56.447006 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":97,"threads_started":1}
I20260808 10:01:56.447736 19113 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33735
I20260808 10:01:56.447860 19113 heartbeater.cc:464] Registering TS with master...
I20260808 10:01:56.448081 19113 heartbeater.cc:511] Master 127.24.71.254:33735 requested a full tablet report, sending...
I20260808 10:01:56.448550 18561 ts_manager.cc:194] Registered new tserver with Master: 3499bfd15e0b4b3091e202880a8a7f97 (127.24.71.194:38871)
I20260808 10:01:56.449134 18561 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:58207
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 10:01:56.470614 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33735
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:40067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:01:56.556056 19121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:56.556309 19121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:56.556353 19121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:56.557574 19121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:56.557646 19121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:56.557691 19121 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:01:56.559341 19121 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:40067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:56.559671 19121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:56.559923 19121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:56.565294 19131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:56.565330 19130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:56.565445 19121 server_base.cc:1034] running on GCE node
W20260808 10:01:56.565353 19133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:56.565742 19121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:56.566035 19121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:56.567214 19121 hybrid_clock.cc:648] HybridClock initialized: now 1786183316567193 us; error 30 us; skew 500 ppm
Aug 08 10:01:56 dist-test-slave-gw5c krb5kdc[18490](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183316, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:56.570021 19121 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 10:01:56.570616 19121 webserver.cc:460] Webserver started at http://127.24.71.195:35963/ using document root <none> and password file <none>
I20260808 10:01:56.570866 19121 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:56.570919 19121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:56.571046 19121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:01:56.572244 19121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "793a519f05ab4c34aa5c07c7aca8d925"
format_stamp: "Formatted at 2026-08-08 10:01:56 on dist-test-slave-gw5c"
server_key: "73cbe5f519fae952514532cfd5e89112"
server_key_iv: "8a42969f43aa167ca45991e4f92aef63"
server_key_version: "encryptionkey@0"
I20260808 10:01:56.572618 19121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "793a519f05ab4c34aa5c07c7aca8d925"
format_stamp: "Formatted at 2026-08-08 10:01:56 on dist-test-slave-gw5c"
server_key: "73cbe5f519fae952514532cfd5e89112"
server_key_iv: "8a42969f43aa167ca45991e4f92aef63"
server_key_version: "encryptionkey@0"
I20260808 10:01:56.573982 19121 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 10:01:56.574705 19143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:56.574877 19121 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:01:56.574975 19121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "793a519f05ab4c34aa5c07c7aca8d925"
format_stamp: "Formatted at 2026-08-08 10:01:56 on dist-test-slave-gw5c"
server_key: "73cbe5f519fae952514532cfd5e89112"
server_key_iv: "8a42969f43aa167ca45991e4f92aef63"
server_key_version: "encryptionkey@0"
I20260808 10:01:56.575052 19121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:56.594384 19121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:56.597010 19121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:56.597174 19121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:56.597491 19121 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:56.597887 19121 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:01:56.597944 19121 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:56.597985 19121 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:01:56.598007 19121 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:56.604532 19121 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:40559
I20260808 10:01:56.604616 19346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:40559 every 8 connection(s)
I20260808 10:01:56.604944 19121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 10:01:56.606567 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 19121
I20260808 10:01:56.606671 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 10:01:56.606846 24863 external_mini_cluster.cc:1428] Setting key 59e1cfdf33d0c3787b6f18e5ffc2bb38
Aug 08 10:01:56 dist-test-slave-gw5c krb5kdc[18490](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183316, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:01:56.614559 18619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.605685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:52243 (local address 127.24.71.254:33735)
0808 10:01:56.605743 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:56.605745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:56.605930 (+ 185us) server_negotiation.cc:407] Connection header received
0808 10:01:56.606504 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:56.606506 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:56.606519 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:56.606580 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:56.607899 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.608406 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.609423 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.609622 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.609698 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.611868 (+ 2170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:56.611870 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:56.611871 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:56.611879 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:56.613117 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:56.613554 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:56.613555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:56.613555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:56.613613 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:56.613857 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:56.613858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:56.613858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:56.614011 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:56.614087 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:56.614370 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 10:01:56.614464 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 10:01:56.614758 19350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.605655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33735 (local address 127.24.71.195:52243)
0808 10:01:56.605806 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:56.605843 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:56.606375 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:56.606652 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:56.606668 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:56.607513 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:56.607806 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.607812 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.608509 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.608510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.609333 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.609335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.609708 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.609709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.609853 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.610328 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:01:56.610336 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:56.611764 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:56.613221 (+ 1457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:56.613229 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:56.613231 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:56.613467 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:56.613677 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:56.613678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:56.613678 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:56.613791 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:56.614092 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:56.614100 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:56.614240 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 10:01:56.614349 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 10:01:56.614512 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":69,"threads_started":1}
I20260808 10:01:56.615209 19347 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33735
I20260808 10:01:56.615304 19347 heartbeater.cc:464] Registering TS with master...
I20260808 10:01:56.615510 19347 heartbeater.cc:511] Master 127.24.71.254:33735 requested a full tablet report, sending...
I20260808 10:01:56.615881 18561 ts_manager.cc:194] Registered new tserver with Master: 793a519f05ab4c34aa5c07c7aca8d925 (127.24.71.195:40559)
I20260808 10:01:56.616226 18561 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:52243
I20260808 10:01:56.618546 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 10:01:56.625558 18619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.620042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39140 (local address 127.24.71.254:33735)
0808 10:01:56.620085 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:56.620087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:56.620181 (+ 94us) server_negotiation.cc:407] Connection header received
0808 10:01:56.620237 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:56.620238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:56.620246 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:56.620290 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:56.620815 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.621269 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.621942 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.622125 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.622175 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.623367 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:56.623368 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:56.623368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:56.623373 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:56.624581 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:56.624886 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:56.624886 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:56.624887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:56.624938 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:56.625091 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:56.625091 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:56.625092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:56.625231 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:56.625306 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:56.625405 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 10:01:56.625464 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 10:01:56.627228 18561 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 10:01:56.628954 18561 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 10:01:56.635761 19368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.631306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:40559 (local address 127.0.0.1:44386)
0808 10:01:56.631835 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:56.631848 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:56.631919 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:56.632160 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:56.632164 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:56.632168 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:56.632248 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.632251 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.633330 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.633331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.634572 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.634575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.635385 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.635386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.635504 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.635518 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 10:01:56.635620 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 10:01:56.635681 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":68,"threads_started":1}
I20260808 10:01:56.635780 19367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.631442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44386 (local address 127.24.71.195:40559)
0808 10:01:56.631670 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:56.631675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:56.631924 (+ 249us) server_negotiation.cc:407] Connection header received
0808 10:01:56.632007 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:56.632009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:56.632028 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:56.632143 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:56.632386 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.633227 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.634667 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.635296 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.635386 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.635475 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:56.635640 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 10:01:56.635681 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":105,"threads_started":1}
I20260808 10:01:56.635924 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.631304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:36327 (local address 127.0.0.1:41852)
0808 10:01:56.631599 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:56.631645 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:56.631719 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:56.632395 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:56.632396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:56.632398 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:56.632447 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.632449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.633694 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.633695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.634727 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.634729 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.635690 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.635691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.635760 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.635764 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:01:56.635796 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 10:01:56.635841 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":8,"thread_start_us":116,"threads_started":1}
I20260808 10:01:56.636054 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.631575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:38871 (local address 127.0.0.1:43834)
0808 10:01:56.632245 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:56.632255 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:56.632308 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:56.632607 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:56.632608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:56.632611 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:56.632654 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.632655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.633907 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.633908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.634849 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.634852 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.635829 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.635830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.635886 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.635901 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 10:01:56.635950 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 10:01:56.635988 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":96,"threads_started":1}
I20260808 10:01:56.636340 19374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.631828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43834 (local address 127.24.71.194:38871)
0808 10:01:56.632068 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:56.632072 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:56.632326 (+ 254us) server_negotiation.cc:407] Connection header received
0808 10:01:56.632375 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:56.632378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:56.632420 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:56.632515 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:56.632741 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.633788 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.634946 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.635687 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.635746 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.635800 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:56.636197 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 10:01:56.636245 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":108,"threads_started":1}
I20260808 10:01:56.636579 19370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.631602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41852 (local address 127.24.71.193:36327)
0808 10:01:56.632064 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:56.632069 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:56.632079 (+ 10us) server_negotiation.cc:407] Connection header received
0808 10:01:56.632122 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:56.632125 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:56.632141 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:56.632412 (+ 271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:56.632513 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.633584 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.634807 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.635584 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.636341 (+ 757us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.636425 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:56.636454 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 10:01:56.636500 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":79,"threads_started":1}
I20260808 10:01:56.636783 19230 tablet_service.cc:1467] Processing CreateTablet for tablet 0bfda55d769d450e9f425ea963aba33e (DEFAULT_TABLE table=test-table [id=2e8dbc2cfd9a46818a53e5e8452d7e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:01:56.636981 19000 tablet_service.cc:1467] Processing CreateTablet for tablet 0bfda55d769d450e9f425ea963aba33e (DEFAULT_TABLE table=test-table [id=2e8dbc2cfd9a46818a53e5e8452d7e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:01:56.637188 19230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bfda55d769d450e9f425ea963aba33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:56.637192 18761 tablet_service.cc:1467] Processing CreateTablet for tablet 0bfda55d769d450e9f425ea963aba33e (DEFAULT_TABLE table=test-table [id=2e8dbc2cfd9a46818a53e5e8452d7e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:01:56.637331 19000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bfda55d769d450e9f425ea963aba33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:56.637502 18761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bfda55d769d450e9f425ea963aba33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:56.640275 19375 tablet_bootstrap.cc:492] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97: Bootstrap starting.
I20260808 10:01:56.640843 19383 tablet_bootstrap.cc:492] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925: Bootstrap starting.
I20260808 10:01:56.641083 19384 tablet_bootstrap.cc:492] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1: Bootstrap starting.
I20260808 10:01:56.641237 19375 tablet_bootstrap.cc:654] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:56.641582 19383 tablet_bootstrap.cc:654] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:56.641739 19384 tablet_bootstrap.cc:654] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:56.641932 19375 log.cc:824] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:56.642213 19383 log.cc:824] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:56.642351 19384 log.cc:824] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:56.642787 19375 tablet_bootstrap.cc:492] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97: No bootstrap required, opened a new log
I20260808 10:01:56.642871 19375 ts_tablet_manager.cc:1397] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 10:01:56.643117 19384 tablet_bootstrap.cc:492] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1: No bootstrap required, opened a new log
I20260808 10:01:56.643198 19384 ts_tablet_manager.cc:1397] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 10:01:56.643348 19383 tablet_bootstrap.cc:492] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925: No bootstrap required, opened a new log
I20260808 10:01:56.643467 19383 ts_tablet_manager.cc:1397] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 10:01:56.644691 19384 raft_consensus.cc:348] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793a519f05ab4c34aa5c07c7aca8d925" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 40559 } } peers { permanent_uuid: "1652b44d88fd4e8a8bf05d3f77e721a1" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 36327 } } peers { permanent_uuid: "3499bfd15e0b4b3091e202880a8a7f97" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38871 } }
I20260808 10:01:56.644876 19384 raft_consensus.cc:374] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:56.644932 19384 raft_consensus.cc:729] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1652b44d88fd4e8a8bf05d3f77e721a1, State: Initialized, Role: FOLLOWER
I20260808 10:01:56.645057 19384 consensus_queue.cc:260] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793a519f05ab4c34aa5c07c7aca8d925" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 40559 } } peers { permanent_uuid: "1652b44d88fd4e8a8bf05d3f77e721a1" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 36327 } } peers { permanent_uuid: "3499bfd15e0b4b3091e202880a8a7f97" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38871 } }
I20260808 10:01:56.645056 19375 raft_consensus.cc:348] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793a519f05ab4c34aa5c07c7aca8d925" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 40559 } } peers { permanent_uuid: "1652b44d88fd4e8a8bf05d3f77e721a1" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 36327 } } peers { permanent_uuid: "3499bfd15e0b4b3091e202880a8a7f97" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38871 } }
I20260808 10:01:56.645243 19375 raft_consensus.cc:374] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:56.645299 19375 raft_consensus.cc:729] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3499bfd15e0b4b3091e202880a8a7f97, State: Initialized, Role: FOLLOWER
I20260808 10:01:56.645375 19384 ts_tablet_manager.cc:1428] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 10:01:56.645519 18873 heartbeater.cc:503] Master 127.24.71.254:33735 was elected leader, sending a full tablet report...
I20260808 10:01:56.645623 19383 raft_consensus.cc:348] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793a519f05ab4c34aa5c07c7aca8d925" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 40559 } } peers { permanent_uuid: "1652b44d88fd4e8a8bf05d3f77e721a1" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 36327 } } peers { permanent_uuid: "3499bfd15e0b4b3091e202880a8a7f97" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38871 } }
I20260808 10:01:56.645797 19383 raft_consensus.cc:374] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:56.645844 19383 raft_consensus.cc:729] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 793a519f05ab4c34aa5c07c7aca8d925, State: Initialized, Role: FOLLOWER
I20260808 10:01:56.645802 19375 consensus_queue.cc:260] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793a519f05ab4c34aa5c07c7aca8d925" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 40559 } } peers { permanent_uuid: "1652b44d88fd4e8a8bf05d3f77e721a1" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 36327 } } peers { permanent_uuid: "3499bfd15e0b4b3091e202880a8a7f97" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38871 } }
I20260808 10:01:56.646055 19383 consensus_queue.cc:260] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793a519f05ab4c34aa5c07c7aca8d925" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 40559 } } peers { permanent_uuid: "1652b44d88fd4e8a8bf05d3f77e721a1" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 36327 } } peers { permanent_uuid: "3499bfd15e0b4b3091e202880a8a7f97" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38871 } }
I20260808 10:01:56.646130 19375 ts_tablet_manager.cc:1428] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 10:01:56.646149 19113 heartbeater.cc:503] Master 127.24.71.254:33735 was elected leader, sending a full tablet report...
I20260808 10:01:56.646354 19383 ts_tablet_manager.cc:1428] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 10:01:56.646364 19347 heartbeater.cc:503] Master 127.24.71.254:33735 was elected leader, sending a full tablet report...
W20260808 10:01:56.687052 19114 tablet.cc:2369] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 10:01:56.771847 18876 tablet.cc:2369] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:01:56.808188 19401 raft_consensus.cc:482] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:01:56.808374 19401 raft_consensus.cc:504] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793a519f05ab4c34aa5c07c7aca8d925" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 40559 } } peers { permanent_uuid: "1652b44d88fd4e8a8bf05d3f77e721a1" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 36327 } } peers { permanent_uuid: "3499bfd15e0b4b3091e202880a8a7f97" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38871 } }
I20260808 10:01:56.808790 19401 leader_election.cc:288] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 793a519f05ab4c34aa5c07c7aca8d925 (127.24.71.195:40559), 1652b44d88fd4e8a8bf05d3f77e721a1 (127.24.71.193:36327)
I20260808 10:01:56.811645 19367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.809089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:37261 (local address 127.24.71.195:40559)
0808 10:01:56.809151 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:56.809153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:56.809163 (+ 10us) server_negotiation.cc:407] Connection header received
0808 10:01:56.809197 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:56.809198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:56.809208 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:56.809264 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:56.809439 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.809922 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.810843 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.811239 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.811322 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.811331 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:56.811539 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 10:01:56.811579 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 10:01:56.811645 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.808965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:40559 (local address 127.24.71.194:37261)
0808 10:01:56.809023 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:56.809037 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:56.809093 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:56.809284 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:56.809285 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:56.809287 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:56.809363 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.809365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.810011 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.810012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.810747 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.810749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.811334 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.811335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.811459 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.811463 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:01:56.811519 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 10:01:56.811565 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 10:01:56.811794 19407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.808994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:36327 (local address 127.24.71.194:36265)
0808 10:01:56.809223 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:56.809232 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:56.809312 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:56.809473 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:56.809474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:56.809476 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:56.809554 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.809556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.810185 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.810186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.810942 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:56.810944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.811522 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.811523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:56.811603 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.811606 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 10:01:56.811665 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 10:01:56.811708 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":137,"threads_started":1}
I20260808 10:01:56.811787 19370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.809135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:36265 (local address 127.24.71.193:36327)
0808 10:01:56.809189 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:56.809191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:56.809297 (+ 106us) server_negotiation.cc:407] Connection header received
0808 10:01:56.809378 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:56.809379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:56.809398 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:56.809467 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:56.809627 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.810092 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.811037 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.811435 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.811521 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.811530 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:56.811684 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 10:01:56.811727 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 10:01:56.812093 18798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bfda55d769d450e9f425ea963aba33e" candidate_uuid: "3499bfd15e0b4b3091e202880a8a7f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1652b44d88fd4e8a8bf05d3f77e721a1" is_pre_election: true
I20260808 10:01:56.812086 19282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bfda55d769d450e9f425ea963aba33e" candidate_uuid: "3499bfd15e0b4b3091e202880a8a7f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "793a519f05ab4c34aa5c07c7aca8d925" is_pre_election: true
I20260808 10:01:56.812263 19282 raft_consensus.cc:2454] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3499bfd15e0b4b3091e202880a8a7f97 in term 0.
I20260808 10:01:56.812263 18798 raft_consensus.cc:2454] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3499bfd15e0b4b3091e202880a8a7f97 in term 0.
I20260808 10:01:56.812511 18916 leader_election.cc:302] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1652b44d88fd4e8a8bf05d3f77e721a1, 3499bfd15e0b4b3091e202880a8a7f97; no voters:
I20260808 10:01:56.812718 19401 raft_consensus.cc:2781] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 10:01:56.812788 19401 raft_consensus.cc:482] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 10:01:56.812814 19401 raft_consensus.cc:3037] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:56.813570 19401 raft_consensus.cc:504] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793a519f05ab4c34aa5c07c7aca8d925" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 40559 } } peers { permanent_uuid: "1652b44d88fd4e8a8bf05d3f77e721a1" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 36327 } } peers { permanent_uuid: "3499bfd15e0b4b3091e202880a8a7f97" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38871 } }
I20260808 10:01:56.813720 19401 leader_election.cc:288] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [CANDIDATE]: Term 1 election: Requested vote from peers 793a519f05ab4c34aa5c07c7aca8d925 (127.24.71.195:40559), 1652b44d88fd4e8a8bf05d3f77e721a1 (127.24.71.193:36327)
I20260808 10:01:56.813862 19282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bfda55d769d450e9f425ea963aba33e" candidate_uuid: "3499bfd15e0b4b3091e202880a8a7f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "793a519f05ab4c34aa5c07c7aca8d925"
I20260808 10:01:56.813922 18798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bfda55d769d450e9f425ea963aba33e" candidate_uuid: "3499bfd15e0b4b3091e202880a8a7f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1652b44d88fd4e8a8bf05d3f77e721a1"
I20260808 10:01:56.813961 19282 raft_consensus.cc:3037] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:56.814009 18798 raft_consensus.cc:3037] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:56.814731 18798 raft_consensus.cc:2454] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3499bfd15e0b4b3091e202880a8a7f97 in term 1.
I20260808 10:01:56.814735 19282 raft_consensus.cc:2454] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3499bfd15e0b4b3091e202880a8a7f97 in term 1.
I20260808 10:01:56.814937 18916 leader_election.cc:302] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1652b44d88fd4e8a8bf05d3f77e721a1, 3499bfd15e0b4b3091e202880a8a7f97; no voters:
I20260808 10:01:56.815155 19401 raft_consensus.cc:2781] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:01:56.815335 19401 raft_consensus.cc:686] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [term 1 LEADER]: Becoming Leader. State: Replica: 3499bfd15e0b4b3091e202880a8a7f97, State: Running, Role: LEADER
I20260808 10:01:56.815466 19401 consensus_queue.cc:237] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793a519f05ab4c34aa5c07c7aca8d925" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 40559 } } peers { permanent_uuid: "1652b44d88fd4e8a8bf05d3f77e721a1" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 36327 } } peers { permanent_uuid: "3499bfd15e0b4b3091e202880a8a7f97" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38871 } }
I20260808 10:01:56.816349 18559 catalog_manager.cc:5495] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3499bfd15e0b4b3091e202880a8a7f97 (127.24.71.194). New cstate: current_term: 1 leader_uuid: "3499bfd15e0b4b3091e202880a8a7f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793a519f05ab4c34aa5c07c7aca8d925" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1652b44d88fd4e8a8bf05d3f77e721a1" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3499bfd15e0b4b3091e202880a8a7f97" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38871 } health_report { overall_health: HEALTHY } } }
W20260808 10:01:56.855608 19348 tablet.cc:2369] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:01:56.861698 19374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.859460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43850 (local address 127.24.71.194:38871)
0808 10:01:56.859522 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:56.859523 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:56.859531 (+ 8us) server_negotiation.cc:407] Connection header received
0808 10:01:56.859572 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:56.859573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:56.859593 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:56.859657 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:01:56.859768 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.860241 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.861000 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:56.861190 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:56.861245 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:56.861398 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:01:56.861502 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:01:56.861568 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:56.861601 (+ 33us) server_negotiation.cc:299] Negotiation successful
0808 10:01:56.861618 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 10:01:56.863703 19282 raft_consensus.cc:1261] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925 [term 1 FOLLOWER]: Refusing update from remote peer 3499bfd15e0b4b3091e202880a8a7f97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:01:56.863709 18798 raft_consensus.cc:1261] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1 [term 1 FOLLOWER]: Refusing update from remote peer 3499bfd15e0b4b3091e202880a8a7f97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:01:56.864113 19408 consensus_queue.cc:1035] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "793a519f05ab4c34aa5c07c7aca8d925" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:01:56.864250 19401 consensus_queue.cc:1035] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1652b44d88fd4e8a8bf05d3f77e721a1" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:01:56.867331 19415 mvcc.cc:205] Tried to move back new op lower bound from 7316206865870909440 to 7316206865676709888. Current Snapshot: MvccSnapshot[applied={T|T < 7316206865870909440 or (T in {7316206865870909440})}]
I20260808 10:01:56.866771 19414 mvcc.cc:205] Tried to move back new op lower bound from 7316206865870909440 to 7316206865676709888. Current Snapshot: MvccSnapshot[applied={T|T < 7316206865870909440 or (T in {7316206865870909440})}]
I20260808 10:01:56.869427 18559 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:01:56.869532 18559 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:01:56.870301 18559 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c288ae8ca3f468ab64318a34e116349: Sending DeleteTablet for 3 replicas of tablet 0bfda55d769d450e9f425ea963aba33e
I20260808 10:01:56.870635 19230 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bfda55d769d450e9f425ea963aba33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:01:56 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:44386
I20260808 10:01:56.870693 18761 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bfda55d769d450e9f425ea963aba33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:01:56 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:41852
I20260808 10:01:56.870868 19425 tablet_replica.cc:330] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925: stopping tablet replica
I20260808 10:01:56.870975 19425 raft_consensus.cc:2229] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:01:56.870968 19427 tablet_replica.cc:330] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1: stopping tablet replica
I20260808 10:01:56.871049 19000 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bfda55d769d450e9f425ea963aba33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:01:56 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:43834
I20260808 10:01:56.871091 19425 raft_consensus.cc:2258] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:01:56.871284 19427 raft_consensus.cc:2229] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:01:56.871472 19427 raft_consensus.cc:2258] T 0bfda55d769d450e9f425ea963aba33e P 1652b44d88fd4e8a8bf05d3f77e721a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:01:56.871501 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 18654
I20260808 10:01:56.881603 19425 ts_tablet_manager.cc:1905] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:01:56.881955 19428 tablet_replica.cc:330] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97: stopping tablet replica
I20260808 10:01:56.882177 19428 raft_consensus.cc:2229] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [term 1 LEADER]: Raft consensus shutting down.
I20260808 10:01:56.882355 19428 raft_consensus.cc:2258] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:01:56.882932 19428 ts_tablet_manager.cc:1905] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:01:56.883939 19425 ts_tablet_manager.cc:1918] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:01:56.884047 19425 log.cc:1196] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/0bfda55d769d450e9f425ea963aba33e
I20260808 10:01:56.884378 19425 ts_tablet_manager.cc:1939] T 0bfda55d769d450e9f425ea963aba33e P 793a519f05ab4c34aa5c07c7aca8d925: Deleting consensus metadata
I20260808 10:01:56.884913 18539 catalog_manager.cc:4841] TS 793a519f05ab4c34aa5c07c7aca8d925 (127.24.71.195:40559): tablet 0bfda55d769d450e9f425ea963aba33e (table test-table [id=2e8dbc2cfd9a46818a53e5e8452d7e09]) successfully deleted
I20260808 10:01:56.884976 19428 ts_tablet_manager.cc:1918] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:01:56.885135 19428 log.cc:1196] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/0bfda55d769d450e9f425ea963aba33e
I20260808 10:01:56.885418 19428 ts_tablet_manager.cc:1939] T 0bfda55d769d450e9f425ea963aba33e P 3499bfd15e0b4b3091e202880a8a7f97: Deleting consensus metadata
I20260808 10:01:56.885874 18539 catalog_manager.cc:4841] TS 3499bfd15e0b4b3091e202880a8a7f97 (127.24.71.194:38871): tablet 0bfda55d769d450e9f425ea963aba33e (table test-table [id=2e8dbc2cfd9a46818a53e5e8452d7e09]) successfully deleted
W20260808 10:01:56.886497 18536 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:36327 (error 108)
I20260808 10:01:56.886732 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 18884
I20260808 10:01:56.894692 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:56.894486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:36327 (local address 127.0.0.1:41868)
0808 10:01:56.894567 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:56.894640 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:36327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 10:01:56.894896 18536 catalog_manager.cc:4584] TS 1652b44d88fd4e8a8bf05d3f77e721a1 (127.24.71.193:36327): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0bfda55d769d450e9f425ea963aba33e: Network error: Client connection negotiation failed: client connection to 127.24.71.193:36327: connect: Connection refused (error 111)
I20260808 10:01:56.901657 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 19121
I20260808 10:01:56.912457 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 18512
2026-08-08T10:01:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2355 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T10:01:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:01:56Z Disabled control of system clock
I20260808 10:01:56.951148 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33397
--webserver_interface=127.24.71.254
--webserver_port=0
--builtin_ntp_servers=127.24.71.212:41997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:33397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 10:01:57.035828 19438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:57.036067 19438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:57.036088 19438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:57.037781 19438 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:01:57.037833 19438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:57.037846 19438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:57.037859 19438 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:01:57.037873 19438 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:01:57.039233 19438 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:33397
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:33397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:57.039506 19438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:57.039767 19438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:57.044795 19446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:57.044691 19444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:57.044691 19449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:57.045017 19438 server_base.cc:1034] running on GCE node
I20260808 10:01:57.045346 19438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:57.045646 19438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:57.046809 19438 hybrid_clock.cc:648] HybridClock initialized: now 1786183317046792 us; error 45 us; skew 500 ppm
I20260808 10:01:57.048094 19438 webserver.cc:460] Webserver started at http://127.24.71.254:46227/ using document root <none> and password file <none>
I20260808 10:01:57.048337 19438 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:57.048405 19438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:57.048558 19438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:01:57.049723 19438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "e68dd619298c435ca2bfe0dad94b66b5"
format_stamp: "Formatted at 2026-08-08 10:01:57 on dist-test-slave-gw5c"
server_key: "f4af8bf4c8eb62f8506bec8037ecaa32"
server_key_iv: "18d04adc5e9a3219882d60e445181591"
server_key_version: "encryptionkey@0"
I20260808 10:01:57.050170 19438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "e68dd619298c435ca2bfe0dad94b66b5"
format_stamp: "Formatted at 2026-08-08 10:01:57 on dist-test-slave-gw5c"
server_key: "f4af8bf4c8eb62f8506bec8037ecaa32"
server_key_iv: "18d04adc5e9a3219882d60e445181591"
server_key_version: "encryptionkey@0"
I20260808 10:01:57.051533 19438 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 10:01:57.052270 19457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:57.052470 19438 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:01:57.052570 19438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "e68dd619298c435ca2bfe0dad94b66b5"
format_stamp: "Formatted at 2026-08-08 10:01:57 on dist-test-slave-gw5c"
server_key: "f4af8bf4c8eb62f8506bec8037ecaa32"
server_key_iv: "18d04adc5e9a3219882d60e445181591"
server_key_version: "encryptionkey@0"
I20260808 10:01:57.052656 19438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:57.068809 19438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:57.069157 19438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:57.069311 19438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:57.073398 19438 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:33397
I20260808 10:01:57.073441 19541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:33397 every 8 connection(s)
I20260808 10:01:57.073814 19438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:01:57.074853 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:57.075973 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 19438
I20260808 10:01:57.076088 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:01:57.076272 24863 external_mini_cluster.cc:1428] Setting key de85a1dee2c148d27a41c6aa1dc68018
I20260808 10:01:57.077927 19542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5: Bootstrap starting.
I20260808 10:01:57.078593 19542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:57.078914 19542 log.cc:824] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:57.079668 19542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5: No bootstrap required, opened a new log
I20260808 10:01:57.081864 19542 raft_consensus.cc:348] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e68dd619298c435ca2bfe0dad94b66b5" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33397 } }
I20260808 10:01:57.082049 19542 raft_consensus.cc:374] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:57.082099 19546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.076835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56840 (local address 127.24.71.254:33397)
0808 10:01:57.077057 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:57.077066 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:57.077101 (+ 35us) server_negotiation.cc:407] Connection header received
0808 10:01:57.077625 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:57.077634 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:57.077717 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:57.077870 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:57.078120 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.079103 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.079984 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.080400 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.080527 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.081349 (+ 822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:57.081356 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:57.081357 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:01:57.081607 (+ 250us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:57.081665 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:01:57.081680 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:57.081746 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:57.081816 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 10:01:57.081899 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260808 10:01:57.082088 19542 raft_consensus.cc:729] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e68dd619298c435ca2bfe0dad94b66b5, State: Initialized, Role: FOLLOWER
I20260808 10:01:57.082249 19542 consensus_queue.cc:260] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e68dd619298c435ca2bfe0dad94b66b5" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33397 } }
I20260808 10:01:57.082351 19542 raft_consensus.cc:388] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:01:57.082397 19542 raft_consensus.cc:482] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:01:57.082450 19542 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:57.083130 19542 raft_consensus.cc:504] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e68dd619298c435ca2bfe0dad94b66b5" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33397 } }
I20260808 10:01:57.083226 19542 leader_election.cc:302] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e68dd619298c435ca2bfe0dad94b66b5; no voters:
I20260808 10:01:57.083366 19542 leader_election.cc:288] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:01:57.083462 19549 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:01:57.083612 19549 raft_consensus.cc:686] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [term 1 LEADER]: Becoming Leader. State: Replica: e68dd619298c435ca2bfe0dad94b66b5, State: Running, Role: LEADER
I20260808 10:01:57.083686 19542 sys_catalog.cc:564] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:01:57.083703 19549 consensus_queue.cc:237] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e68dd619298c435ca2bfe0dad94b66b5" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33397 } }
I20260808 10:01:57.084097 19550 sys_catalog.cc:455] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e68dd619298c435ca2bfe0dad94b66b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e68dd619298c435ca2bfe0dad94b66b5" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33397 } } }
I20260808 10:01:57.084105 19552 sys_catalog.cc:455] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e68dd619298c435ca2bfe0dad94b66b5. Latest consensus state: current_term: 1 leader_uuid: "e68dd619298c435ca2bfe0dad94b66b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e68dd619298c435ca2bfe0dad94b66b5" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 33397 } } }
I20260808 10:01:57.084280 19552 sys_catalog.cc:458] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [sys.catalog]: This master's current role is: LEADER
I20260808 10:01:57.084225 19550 sys_catalog.cc:458] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5 [sys.catalog]: This master's current role is: LEADER
I20260808 10:01:57.084730 19565 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:01:57.085243 19565 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:01:57.086822 19565 catalog_manager.cc:1347] Generated new cluster ID: bd145185ff844d92880e2418986ea25f
I20260808 10:01:57.086880 19565 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:01:57.099195 19565 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:01:57.099939 19565 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:01:57.113112 19565 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5: Generated new TSK 0
I20260808 10:01:57.113350 19565 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:01:57.115789 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33397
--builtin_ntp_servers=127.24.71.212:41997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 10:01:57.200712 19583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:57.200922 19583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:57.200945 19583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:57.202103 19583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:57.202147 19583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:57.202173 19583 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:01:57.203616 19583 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:57.203881 19583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:57.204205 19583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:57.210368 19592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:57.210359 19589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:57.210367 19588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:57.210848 19583 server_base.cc:1034] running on GCE node
I20260808 10:01:57.211043 19583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:57.211326 19583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:57.212481 19583 hybrid_clock.cc:648] HybridClock initialized: now 1786183317212478 us; error 35 us; skew 500 ppm
I20260808 10:01:57.213786 19583 webserver.cc:460] Webserver started at http://127.24.71.193:45917/ using document root <none> and password file <none>
I20260808 10:01:57.214061 19583 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:57.214131 19583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:57.214286 19583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:01:57.215382 19583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "75edf2858106401a88a54c0f2c7427a6"
format_stamp: "Formatted at 2026-08-08 10:01:57 on dist-test-slave-gw5c"
server_key: "5ca22a29eb06bfb910a80f331f17d223"
server_key_iv: "dd412c31cff925f95861d5aa8ed789ac"
server_key_version: "encryptionkey@0"
I20260808 10:01:57.215827 19583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "75edf2858106401a88a54c0f2c7427a6"
format_stamp: "Formatted at 2026-08-08 10:01:57 on dist-test-slave-gw5c"
server_key: "5ca22a29eb06bfb910a80f331f17d223"
server_key_iv: "dd412c31cff925f95861d5aa8ed789ac"
server_key_version: "encryptionkey@0"
I20260808 10:01:57.217185 19583 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 10:01:57.217968 19601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:57.218204 19583 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:57.218313 19583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "75edf2858106401a88a54c0f2c7427a6"
format_stamp: "Formatted at 2026-08-08 10:01:57 on dist-test-slave-gw5c"
server_key: "5ca22a29eb06bfb910a80f331f17d223"
server_key_iv: "dd412c31cff925f95861d5aa8ed789ac"
server_key_version: "encryptionkey@0"
I20260808 10:01:57.218396 19583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:57.235150 19583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:57.235507 19583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:57.235622 19583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:57.235842 19583 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:57.236254 19583 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:01:57.236292 19583 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:57.236351 19583 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:01:57.236377 19583 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:57.242414 19583 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:32907
I20260808 10:01:57.242504 19786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:32907 every 8 connection(s)
I20260808 10:01:57.242849 19583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 10:01:57.248389 19546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.243683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:49171 (local address 127.24.71.254:33397)
0808 10:01:57.243731 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:57.243733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:57.244018 (+ 285us) server_negotiation.cc:407] Connection header received
0808 10:01:57.244595 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:57.244596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:57.244611 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:57.244659 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:57.245363 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.245866 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.246891 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.247092 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.247165 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.248092 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:57.248094 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:57.248094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:01:57.248100 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:57.248114 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:01:57.248119 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:57.248184 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:57.248258 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 10:01:57.248286 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 10:01:57.248611 19790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.243681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33397 (local address 127.24.71.193:49171)
0808 10:01:57.243891 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:57.243929 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:57.244476 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:57.244733 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:57.244737 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:57.244747 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:57.245270 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.245274 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.245978 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.245979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.246783 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.246785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.247189 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.247190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.247324 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.247941 (+ 617us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 10:01:57.247942 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:57.247969 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 10:01:57.247992 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:57.248184 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:57.248191 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:57.248195 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:01:57.248263 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 10:01:57.248370 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":92,"threads_started":1}
I20260808 10:01:57.249132 19787 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33397
I20260808 10:01:57.249241 19787 heartbeater.cc:464] Registering TS with master...
I20260808 10:01:57.249441 19787 heartbeater.cc:511] Master 127.24.71.254:33397 requested a full tablet report, sending...
I20260808 10:01:57.249943 19483 ts_manager.cc:194] Registered new tserver with Master: 75edf2858106401a88a54c0f2c7427a6 (127.24.71.193:32907)
I20260808 10:01:57.250600 19483 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.71.193:49171
I20260808 10:01:57.252833 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 19583
I20260808 10:01:57.252938 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 10:01:57.253131 24863 external_mini_cluster.cc:1428] Setting key 76880003c12c95933a822519353df809
I20260808 10:01:57.254040 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33397
--builtin_ntp_servers=127.24.71.212:41997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 10:01:57.338462 19792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:57.338685 19792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:57.338708 19792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:57.340147 19792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:57.340204 19792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:57.340276 19792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:01:57.342118 19792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:57.342435 19792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:57.342808 19792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:57.348152 19805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:57.348156 19798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:57.348250 19799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:57.348430 19792 server_base.cc:1034] running on GCE node
I20260808 10:01:57.348685 19792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:57.348934 19792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:57.350099 19792 hybrid_clock.cc:648] HybridClock initialized: now 1786183317350081 us; error 37 us; skew 500 ppm
I20260808 10:01:57.351501 19792 webserver.cc:460] Webserver started at http://127.24.71.194:33555/ using document root <none> and password file <none>
I20260808 10:01:57.351747 19792 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:57.351827 19792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:57.351987 19792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:01:57.353103 19792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "60704e05483045e588ce70491cc977ab"
format_stamp: "Formatted at 2026-08-08 10:01:57 on dist-test-slave-gw5c"
server_key: "e42e007552155b60d08c30e59741daa5"
server_key_iv: "c729c64e9aac526a3968eb7bec889046"
server_key_version: "encryptionkey@0"
I20260808 10:01:57.353484 19792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "60704e05483045e588ce70491cc977ab"
format_stamp: "Formatted at 2026-08-08 10:01:57 on dist-test-slave-gw5c"
server_key: "e42e007552155b60d08c30e59741daa5"
server_key_iv: "c729c64e9aac526a3968eb7bec889046"
server_key_version: "encryptionkey@0"
I20260808 10:01:57.354856 19792 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:01:57.355701 19814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:57.355878 19792 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:57.355981 19792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "60704e05483045e588ce70491cc977ab"
format_stamp: "Formatted at 2026-08-08 10:01:57 on dist-test-slave-gw5c"
server_key: "e42e007552155b60d08c30e59741daa5"
server_key_iv: "c729c64e9aac526a3968eb7bec889046"
server_key_version: "encryptionkey@0"
I20260808 10:01:57.356066 19792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:57.370561 19792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:57.370955 19792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:57.371120 19792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:57.371451 19792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:57.371819 19792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:01:57.371876 19792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:57.371910 19792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:01:57.371937 19792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:57.379606 19792 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:38775
I20260808 10:01:57.379657 19982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:38775 every 8 connection(s)
I20260808 10:01:57.380017 19792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 10:01:57.385412 19546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.380748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:35173 (local address 127.24.71.254:33397)
0808 10:01:57.380814 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:57.380817 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:57.381096 (+ 279us) server_negotiation.cc:407] Connection header received
0808 10:01:57.381639 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:57.381640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:57.381654 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:57.381745 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:57.382412 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.382909 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.383983 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.384174 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.384232 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.385172 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:57.385173 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:57.385173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:01:57.385179 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:57.385192 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:01:57.385195 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:57.385240 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:57.385319 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 10:01:57.385345 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 10:01:57.385643 19986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.380746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33397 (local address 127.24.71.194:35173)
0808 10:01:57.380974 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:57.381011 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:57.381514 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:57.381800 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:57.381804 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:57.381814 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:57.382337 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.382342 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.382997 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.382997 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.383900 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.383903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.384254 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.384255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.384373 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.385034 (+ 661us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 10:01:57.385035 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:57.385067 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 10:01:57.385093 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:57.385251 (+ 158us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:57.385256 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:57.385258 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 10:01:57.385312 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 10:01:57.385413 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":105,"threads_started":1}
I20260808 10:01:57.386145 19983 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33397
I20260808 10:01:57.386246 19983 heartbeater.cc:464] Registering TS with master...
I20260808 10:01:57.386461 19983 heartbeater.cc:511] Master 127.24.71.254:33397 requested a full tablet report, sending...
I20260808 10:01:57.386855 19483 ts_manager.cc:194] Registered new tserver with Master: 60704e05483045e588ce70491cc977ab (127.24.71.194:38775)
I20260808 10:01:57.387246 19483 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.71.194:35173
I20260808 10:01:57.390137 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 19792
I20260808 10:01:57.390225 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 10:01:57.390383 24863 external_mini_cluster.cc:1428] Setting key ce042a5f783f714afaa61acfbd6bf08f
I20260808 10:01:57.391314 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33397
--builtin_ntp_servers=127.24.71.212:41997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 10:01:57.477007 19987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:57.477213 19987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:57.477236 19987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:57.478374 19987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:57.478417 19987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:57.478443 19987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:01:57.479853 19987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:33397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:57.480077 19987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:57.480346 19987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:57.485749 19995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:57.485754 20001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:57.486006 19987 server_base.cc:1034] running on GCE node
W20260808 10:01:57.485721 19997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:57.486303 19987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:57.486558 19987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:57.487722 19987 hybrid_clock.cc:648] HybridClock initialized: now 1786183317487711 us; error 40 us; skew 500 ppm
I20260808 10:01:57.489096 19987 webserver.cc:460] Webserver started at http://127.24.71.195:33491/ using document root <none> and password file <none>
I20260808 10:01:57.489362 19987 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:57.489434 19987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:57.489580 19987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:01:57.490695 19987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "f41c88d7508a42369b044030b3473a5a"
format_stamp: "Formatted at 2026-08-08 10:01:57 on dist-test-slave-gw5c"
server_key: "2c4dc184f22f9d7a9d1bcf8c710cbaae"
server_key_iv: "1dcab7e2759a87830f90b8a4eeafe38c"
server_key_version: "encryptionkey@0"
I20260808 10:01:57.491088 19987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "f41c88d7508a42369b044030b3473a5a"
format_stamp: "Formatted at 2026-08-08 10:01:57 on dist-test-slave-gw5c"
server_key: "2c4dc184f22f9d7a9d1bcf8c710cbaae"
server_key_iv: "1dcab7e2759a87830f90b8a4eeafe38c"
server_key_version: "encryptionkey@0"
I20260808 10:01:57.492519 19987 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:01:57.493319 20014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:57.493505 19987 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:01:57.493613 19987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "f41c88d7508a42369b044030b3473a5a"
format_stamp: "Formatted at 2026-08-08 10:01:57 on dist-test-slave-gw5c"
server_key: "2c4dc184f22f9d7a9d1bcf8c710cbaae"
server_key_iv: "1dcab7e2759a87830f90b8a4eeafe38c"
server_key_version: "encryptionkey@0"
I20260808 10:01:57.493687 19987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:57.513358 19987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:57.513760 19987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:57.513948 19987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:57.514225 19987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:57.514601 19987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:01:57.514655 19987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:57.514693 19987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:01:57.514736 19987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:57.520972 19987 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:37719
I20260808 10:01:57.521019 20195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:37719 every 8 connection(s)
I20260808 10:01:57.521377 19987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 10:01:57.526940 19546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.522194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:46301 (local address 127.24.71.254:33397)
0808 10:01:57.522253 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:57.522255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:57.522521 (+ 266us) server_negotiation.cc:407] Connection header received
0808 10:01:57.523092 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:57.523093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:57.523106 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:57.523164 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:57.523955 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.524459 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.525484 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.525682 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.525756 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.526633 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:57.526635 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:57.526635 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:01:57.526641 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:57.526663 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:01:57.526667 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:57.526726 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:57.526821 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 10:01:57.526852 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 10:01:57.527202 20202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.522168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:33397 (local address 127.24.71.195:46301)
0808 10:01:57.522385 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:57.522428 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:57.522982 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:57.523242 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:57.523246 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:57.523254 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:57.523851 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.523857 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.524563 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.524564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.525382 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.525385 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.525781 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.525782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.525925 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.526486 (+ 561us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 10:01:57.526487 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:57.526516 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 10:01:57.526538 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:57.526728 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:57.526735 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:57.526739 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:01:57.526822 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 10:01:57.526942 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":95,"threads_started":1}
I20260808 10:01:57.527546 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 19987
I20260808 10:01:57.527657 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 10:01:57.527838 20197 heartbeater.cc:347] Connected to a master server at 127.24.71.254:33397
I20260808 10:01:57.527884 24863 external_mini_cluster.cc:1428] Setting key 0667ebaed805b750b731e5a65b269084
I20260808 10:01:57.527956 20197 heartbeater.cc:464] Registering TS with master...
I20260808 10:01:57.528203 20197 heartbeater.cc:511] Master 127.24.71.254:33397 requested a full tablet report, sending...
I20260808 10:01:57.528621 19482 ts_manager.cc:194] Registered new tserver with Master: f41c88d7508a42369b044030b3473a5a (127.24.71.195:37719)
I20260808 10:01:57.529049 19482 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.71.195:46301
I20260808 10:01:57.539896 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 10:01:57.544040 19546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.541299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56852 (local address 127.24.71.254:33397)
0808 10:01:57.541348 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:57.541349 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:57.541450 (+ 101us) server_negotiation.cc:407] Connection header received
0808 10:01:57.541509 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:57.541509 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:57.541518 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:57.541571 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:57.541729 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.542218 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.542912 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.543089 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.543139 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.543823 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:57.543824 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:57.543824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:01:57.543829 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:57.543840 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:01:57.543844 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:57.543885 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:57.543959 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 10:01:57.543979 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 10:01:57.545701 19482 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 10:01:57.547305 19482 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 10:01:57.554133 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.550001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:37719 (local address 127.0.0.1:34830)
0808 10:01:57.550263 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:57.550273 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:57.550316 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:57.550587 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:57.550588 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:57.550590 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:57.550648 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.550650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.552000 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.552000 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.553095 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.553098 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.553800 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.553801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.553878 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.553901 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 10:01:57.553990 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 10:01:57.554051 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":52,"thread_start_us":80,"threads_started":1}
I20260808 10:01:57.554147 20221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.550232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34830 (local address 127.24.71.195:37719)
0808 10:01:57.550439 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:57.550443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:57.550453 (+ 10us) server_negotiation.cc:407] Connection header received
0808 10:01:57.550492 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:57.550494 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:57.550508 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:57.550590 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:57.550726 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.551906 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.553186 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.553702 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.553788 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.553890 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:57.554009 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 10:01:57.554053 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":88,"threads_started":1}
I20260808 10:01:57.554524 20208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.549790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:38775 (local address 127.0.0.1:53442)
0808 10:01:57.550087 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:57.550099 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:57.550155 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:57.550667 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:57.550668 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:57.550670 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:57.550706 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.550707 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.551806 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.551806 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.553129 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.553131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.554150 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.554151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.554356 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.554360 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:01:57.554411 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 10:01:57.554449 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":3,"thread_start_us":117,"threads_started":1}
I20260808 10:01:57.554807 20216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.549983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53442 (local address 127.24.71.194:38775)
0808 10:01:57.550448 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:57.550452 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:57.550463 (+ 11us) server_negotiation.cc:407] Connection header received
0808 10:01:57.550505 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:57.550507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:57.550525 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:57.550598 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:57.550765 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.551671 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.553231 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.553967 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.554029 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.554116 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:57.554666 (+ 550us) server_negotiation.cc:299] Negotiation successful
0808 10:01:57.554710 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":111,"threads_started":1}
I20260808 10:01:57.555076 20091 tablet_service.cc:1467] Processing CreateTablet for tablet 0d2a70d4a8a642cca1645aa900afe0f6 (DEFAULT_TABLE table=test-table [id=8c0544d9a31c47dfad7ab5503abdf452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:01:57.555279 20209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.549782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:32907 (local address 127.0.0.1:40844)
0808 10:01:57.549966 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:57.550013 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:57.550088 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:57.550509 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:57.550513 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:57.550515 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:57.550591 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.550593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.552885 (+ 2292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.552886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.553924 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.553927 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.555020 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.555021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.555081 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.555084 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 10:01:57.555158 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 10:01:57.555201 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":66,"threads_started":1}
I20260808 10:01:57.555299 20211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.549877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40844 (local address 127.24.71.193:32907)
0808 10:01:57.550240 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:57.550246 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:57.550258 (+ 12us) server_negotiation.cc:407] Connection header received
0808 10:01:57.550304 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:57.550306 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:57.550323 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:57.550418 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:57.550672 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.551904 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.554036 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.554808 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.554893 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.554986 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:57.555176 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 10:01:57.555218 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":110,"threads_started":1}
I20260808 10:01:57.555552 20091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d2a70d4a8a642cca1645aa900afe0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:57.555713 19895 tablet_service.cc:1467] Processing CreateTablet for tablet 0d2a70d4a8a642cca1645aa900afe0f6 (DEFAULT_TABLE table=test-table [id=8c0544d9a31c47dfad7ab5503abdf452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:01:57.555922 19680 tablet_service.cc:1467] Processing CreateTablet for tablet 0d2a70d4a8a642cca1645aa900afe0f6 (DEFAULT_TABLE table=test-table [id=8c0544d9a31c47dfad7ab5503abdf452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:01:57.556046 19895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d2a70d4a8a642cca1645aa900afe0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:57.556187 19680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d2a70d4a8a642cca1645aa900afe0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:57.558712 20222 tablet_bootstrap.cc:492] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6: Bootstrap starting.
I20260808 10:01:57.559331 20224 tablet_bootstrap.cc:492] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a: Bootstrap starting.
I20260808 10:01:57.559588 20222 tablet_bootstrap.cc:654] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:57.559950 20222 log.cc:824] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:57.560084 20224 tablet_bootstrap.cc:654] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:57.560246 20226 tablet_bootstrap.cc:492] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab: Bootstrap starting.
I20260808 10:01:57.560446 20224 log.cc:824] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:57.560832 20222 tablet_bootstrap.cc:492] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6: No bootstrap required, opened a new log
I20260808 10:01:57.560889 20222 ts_tablet_manager.cc:1397] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 10:01:57.560915 20226 tablet_bootstrap.cc:654] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:57.561244 20226 log.cc:824] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:57.561419 20224 tablet_bootstrap.cc:492] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a: No bootstrap required, opened a new log
I20260808 10:01:57.561507 20224 ts_tablet_manager.cc:1397] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 10:01:57.561964 20226 tablet_bootstrap.cc:492] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab: No bootstrap required, opened a new log
I20260808 10:01:57.562049 20226 ts_tablet_manager.cc:1397] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 10:01:57.563619 20222 raft_consensus.cc:348] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75edf2858106401a88a54c0f2c7427a6" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 32907 } } peers { permanent_uuid: "f41c88d7508a42369b044030b3473a5a" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 37719 } } peers { permanent_uuid: "60704e05483045e588ce70491cc977ab" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38775 } }
I20260808 10:01:57.563802 20222 raft_consensus.cc:374] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:57.563839 20222 raft_consensus.cc:729] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75edf2858106401a88a54c0f2c7427a6, State: Initialized, Role: FOLLOWER
I20260808 10:01:57.563992 20222 consensus_queue.cc:260] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75edf2858106401a88a54c0f2c7427a6" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 32907 } } peers { permanent_uuid: "f41c88d7508a42369b044030b3473a5a" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 37719 } } peers { permanent_uuid: "60704e05483045e588ce70491cc977ab" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38775 } }
I20260808 10:01:57.564146 20224 raft_consensus.cc:348] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75edf2858106401a88a54c0f2c7427a6" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 32907 } } peers { permanent_uuid: "f41c88d7508a42369b044030b3473a5a" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 37719 } } peers { permanent_uuid: "60704e05483045e588ce70491cc977ab" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38775 } }
I20260808 10:01:57.564273 20222 ts_tablet_manager.cc:1428] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260808 10:01:57.564306 20224 raft_consensus.cc:374] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:57.564343 20224 raft_consensus.cc:729] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f41c88d7508a42369b044030b3473a5a, State: Initialized, Role: FOLLOWER
I20260808 10:01:57.564302 20226 raft_consensus.cc:348] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75edf2858106401a88a54c0f2c7427a6" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 32907 } } peers { permanent_uuid: "f41c88d7508a42369b044030b3473a5a" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 37719 } } peers { permanent_uuid: "60704e05483045e588ce70491cc977ab" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38775 } }
I20260808 10:01:57.564430 19787 heartbeater.cc:503] Master 127.24.71.254:33397 was elected leader, sending a full tablet report...
I20260808 10:01:57.564462 20226 raft_consensus.cc:374] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:57.564500 20226 raft_consensus.cc:729] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60704e05483045e588ce70491cc977ab, State: Initialized, Role: FOLLOWER
I20260808 10:01:57.564465 20224 consensus_queue.cc:260] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75edf2858106401a88a54c0f2c7427a6" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 32907 } } peers { permanent_uuid: "f41c88d7508a42369b044030b3473a5a" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 37719 } } peers { permanent_uuid: "60704e05483045e588ce70491cc977ab" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38775 } }
I20260808 10:01:57.564615 20226 consensus_queue.cc:260] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75edf2858106401a88a54c0f2c7427a6" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 32907 } } peers { permanent_uuid: "f41c88d7508a42369b044030b3473a5a" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 37719 } } peers { permanent_uuid: "60704e05483045e588ce70491cc977ab" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38775 } }
I20260808 10:01:57.564749 20197 heartbeater.cc:503] Master 127.24.71.254:33397 was elected leader, sending a full tablet report...
I20260808 10:01:57.564870 20226 ts_tablet_manager.cc:1428] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 10:01:57.564890 19983 heartbeater.cc:503] Master 127.24.71.254:33397 was elected leader, sending a full tablet report...
I20260808 10:01:57.565014 20224 ts_tablet_manager.cc:1428] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 10:01:57.591491 20233 raft_consensus.cc:482] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:01:57.591645 20233 raft_consensus.cc:504] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75edf2858106401a88a54c0f2c7427a6" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 32907 } } peers { permanent_uuid: "f41c88d7508a42369b044030b3473a5a" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 37719 } } peers { permanent_uuid: "60704e05483045e588ce70491cc977ab" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38775 } }
I20260808 10:01:57.592157 20233 leader_election.cc:288] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f41c88d7508a42369b044030b3473a5a (127.24.71.195:37719), 60704e05483045e588ce70491cc977ab (127.24.71.194:38775)
I20260808 10:01:57.595223 20221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.592475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:50819 (local address 127.24.71.195:37719)
0808 10:01:57.592549 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:57.592552 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:57.592660 (+ 108us) server_negotiation.cc:407] Connection header received
0808 10:01:57.592721 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:57.592723 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:57.592732 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:57.592798 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:57.592974 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.593433 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.594455 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.594835 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.594943 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.594953 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:57.595113 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 10:01:57.595153 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 10:01:57.595245 20239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.592360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:37719 (local address 127.24.71.193:50819)
0808 10:01:57.592594 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:57.592602 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:57.592661 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:57.592800 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:57.592801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:57.592802 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:57.592897 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.592899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.593509 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.593510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.594350 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.594352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.594943 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.594944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.595028 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.595032 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:01:57.595104 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 10:01:57.595145 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":47,"thread_start_us":108,"threads_started":1}
I20260808 10:01:57.595424 20216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.592440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:60245 (local address 127.24.71.194:38775)
0808 10:01:57.592497 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:57.592500 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:57.592514 (+ 14us) server_negotiation.cc:407] Connection header received
0808 10:01:57.592553 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:57.592554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:57.592570 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:57.592669 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:57.592861 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.593394 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.594556 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.594966 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.595075 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.595084 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:57.595275 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 10:01:57.595321 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 10:01:57.595424 19790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.592345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:38775 (local address 127.24.71.193:60245)
0808 10:01:57.592420 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:57.592433 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:57.592486 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:57.592676 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:57.592677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:57.592679 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:57.592769 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.592771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.593512 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.593513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.594435 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:57.594437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.595075 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.595077 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:57.595169 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.595173 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:01:57.595265 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 10:01:57.595314 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":40}
I20260808 10:01:57.596022 20121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d2a70d4a8a642cca1645aa900afe0f6" candidate_uuid: "75edf2858106401a88a54c0f2c7427a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f41c88d7508a42369b044030b3473a5a" is_pre_election: true
I20260808 10:01:57.596067 19918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d2a70d4a8a642cca1645aa900afe0f6" candidate_uuid: "75edf2858106401a88a54c0f2c7427a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60704e05483045e588ce70491cc977ab" is_pre_election: true
I20260808 10:01:57.596189 20121 raft_consensus.cc:2454] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75edf2858106401a88a54c0f2c7427a6 in term 0.
I20260808 10:01:57.596335 19918 raft_consensus.cc:2454] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75edf2858106401a88a54c0f2c7427a6 in term 0.
I20260808 10:01:57.596422 19609 leader_election.cc:302] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75edf2858106401a88a54c0f2c7427a6, f41c88d7508a42369b044030b3473a5a; no voters:
I20260808 10:01:57.596578 20233 raft_consensus.cc:2781] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 10:01:57.596637 20233 raft_consensus.cc:482] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 10:01:57.596662 20233 raft_consensus.cc:3037] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:57.597491 20233 raft_consensus.cc:504] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75edf2858106401a88a54c0f2c7427a6" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 32907 } } peers { permanent_uuid: "f41c88d7508a42369b044030b3473a5a" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 37719 } } peers { permanent_uuid: "60704e05483045e588ce70491cc977ab" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38775 } }
I20260808 10:01:57.597640 20233 leader_election.cc:288] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [CANDIDATE]: Term 1 election: Requested vote from peers f41c88d7508a42369b044030b3473a5a (127.24.71.195:37719), 60704e05483045e588ce70491cc977ab (127.24.71.194:38775)
I20260808 10:01:57.597772 20121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d2a70d4a8a642cca1645aa900afe0f6" candidate_uuid: "75edf2858106401a88a54c0f2c7427a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f41c88d7508a42369b044030b3473a5a"
I20260808 10:01:57.597856 20121 raft_consensus.cc:3037] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:57.597838 19918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d2a70d4a8a642cca1645aa900afe0f6" candidate_uuid: "75edf2858106401a88a54c0f2c7427a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60704e05483045e588ce70491cc977ab"
I20260808 10:01:57.597939 19918 raft_consensus.cc:3037] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:57.598707 20121 raft_consensus.cc:2454] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75edf2858106401a88a54c0f2c7427a6 in term 1.
I20260808 10:01:57.598834 19918 raft_consensus.cc:2454] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75edf2858106401a88a54c0f2c7427a6 in term 1.
I20260808 10:01:57.598881 19609 leader_election.cc:302] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75edf2858106401a88a54c0f2c7427a6, f41c88d7508a42369b044030b3473a5a; no voters:
I20260808 10:01:57.598978 20233 raft_consensus.cc:2781] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:01:57.599156 20233 raft_consensus.cc:686] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [term 1 LEADER]: Becoming Leader. State: Replica: 75edf2858106401a88a54c0f2c7427a6, State: Running, Role: LEADER
I20260808 10:01:57.599258 20233 consensus_queue.cc:237] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75edf2858106401a88a54c0f2c7427a6" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 32907 } } peers { permanent_uuid: "f41c88d7508a42369b044030b3473a5a" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 37719 } } peers { permanent_uuid: "60704e05483045e588ce70491cc977ab" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38775 } }
I20260808 10:01:57.600273 19481 catalog_manager.cc:5495] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 75edf2858106401a88a54c0f2c7427a6 (127.24.71.193). New cstate: current_term: 1 leader_uuid: "75edf2858106401a88a54c0f2c7427a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75edf2858106401a88a54c0f2c7427a6" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 32907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f41c88d7508a42369b044030b3473a5a" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 37719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60704e05483045e588ce70491cc977ab" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38775 } health_report { overall_health: UNKNOWN } } }
I20260808 10:01:57.616729 20211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.614499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40856 (local address 127.24.71.193:32907)
0808 10:01:57.614549 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:57.614551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:57.614579 (+ 28us) server_negotiation.cc:407] Connection header received
0808 10:01:57.614617 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:57.614618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:57.614639 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:57.614694 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:01:57.614803 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.615277 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.616069 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:57.616261 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:57.616317 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:57.616431 (+ 114us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:01:57.616538 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:01:57.616594 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:57.616625 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 10:01:57.616643 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 10:01:57.618743 20121 raft_consensus.cc:1261] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a [term 1 FOLLOWER]: Refusing update from remote peer 75edf2858106401a88a54c0f2c7427a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:01:57.618743 19918 raft_consensus.cc:1261] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab [term 1 FOLLOWER]: Refusing update from remote peer 75edf2858106401a88a54c0f2c7427a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:01:57.619138 20240 consensus_queue.cc:1035] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f41c88d7508a42369b044030b3473a5a" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:01:57.619269 20233 consensus_queue.cc:1035] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60704e05483045e588ce70491cc977ab" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 38775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:01:57.621866 20243 mvcc.cc:205] Tried to move back new op lower bound from 7316206868963143680 to 7316206868887425024. Current Snapshot: MvccSnapshot[applied={T|T < 7316206868963143680}]
I20260808 10:01:57.623210 20244 mvcc.cc:205] Tried to move back new op lower bound from 7316206868963143680 to 7316206868887425024. Current Snapshot: MvccSnapshot[applied={T|T < 7316206868963143680 or (T in {7316206868963143680})}]
I20260808 10:01:57.624586 19481 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:01:57.624682 19481 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:01:57.625469 19481 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e68dd619298c435ca2bfe0dad94b66b5: Sending DeleteTablet for 3 replicas of tablet 0d2a70d4a8a642cca1645aa900afe0f6
I20260808 10:01:57.625816 19895 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d2a70d4a8a642cca1645aa900afe0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:01:57 UTC) from {username='slave'} at 127.0.0.1:53442
I20260808 10:01:57.625867 19680 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d2a70d4a8a642cca1645aa900afe0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:01:57 UTC) from {username='slave'} at 127.0.0.1:40844
I20260808 10:01:57.625913 20091 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d2a70d4a8a642cca1645aa900afe0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:01:57 UTC) from {username='slave'} at 127.0.0.1:34830
I20260808 10:01:57.626073 20254 tablet_replica.cc:330] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab: stopping tablet replica
I20260808 10:01:57.626173 20254 raft_consensus.cc:2229] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:01:57.626297 20254 raft_consensus.cc:2258] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:01:57.626358 20256 tablet_replica.cc:330] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6: stopping tablet replica
I20260808 10:01:57.626447 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 19583
I20260808 10:01:57.626459 20256 raft_consensus.cc:2229] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 10:01:57.626554 20256 raft_consensus.cc:2258] T 0d2a70d4a8a642cca1645aa900afe0f6 P 75edf2858106401a88a54c0f2c7427a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:01:57.629748 20254 ts_tablet_manager.cc:1905] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:01:57.631486 20254 ts_tablet_manager.cc:1918] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:01:57.631569 20254 log.cc:1196] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/0d2a70d4a8a642cca1645aa900afe0f6
I20260808 10:01:57.631825 20254 ts_tablet_manager.cc:1939] T 0d2a70d4a8a642cca1645aa900afe0f6 P 60704e05483045e588ce70491cc977ab: Deleting consensus metadata
I20260808 10:01:57.632236 19458 catalog_manager.cc:4841] TS 60704e05483045e588ce70491cc977ab (127.24.71.194:38775): tablet 0d2a70d4a8a642cca1645aa900afe0f6 (table test-table [id=8c0544d9a31c47dfad7ab5503abdf452]) successfully deleted
I20260808 10:01:57.633353 20257 tablet_replica.cc:330] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a: stopping tablet replica
I20260808 10:01:57.633594 20257 raft_consensus.cc:2229] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:01:57.633733 20257 raft_consensus.cc:2258] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:01:57.634189 20257 ts_tablet_manager.cc:1905] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:01:57.635669 20257 ts_tablet_manager.cc:1918] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:01:57.635758 20257 log.cc:1196] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/0d2a70d4a8a642cca1645aa900afe0f6
I20260808 10:01:57.636027 20257 ts_tablet_manager.cc:1939] T 0d2a70d4a8a642cca1645aa900afe0f6 P f41c88d7508a42369b044030b3473a5a: Deleting consensus metadata
I20260808 10:01:57.636519 19461 catalog_manager.cc:4841] TS f41c88d7508a42369b044030b3473a5a (127.24.71.195:37719): tablet 0d2a70d4a8a642cca1645aa900afe0f6 (table test-table [id=8c0544d9a31c47dfad7ab5503abdf452]) successfully deleted
W20260808 10:01:57.637584 19461 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:32907 (error 108)
I20260808 10:01:57.637826 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 19792
I20260808 10:01:57.643091 20209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:57.637960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:32907 (local address 127.0.0.1:40862)
0808 10:01:57.642949 (+ 4989us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:57.643034 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:32907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4952}
W20260808 10:01:57.646646 19461 catalog_manager.cc:4584] TS 75edf2858106401a88a54c0f2c7427a6 (127.24.71.193:32907): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0d2a70d4a8a642cca1645aa900afe0f6: Network error: Client connection negotiation failed: client connection to 127.24.71.193:32907: connect: Connection refused (error 111)
I20260808 10:01:57.652201 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 19987
I20260808 10:01:57.669229 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 19438
2026-08-08T10:01:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (752 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:01:57 dist-test-slave-gw5c krb5kdc[20264](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:01:57 dist-test-slave-gw5c krb5kdc[20264](info): set up 2 sockets
Aug 08 10:01:57 dist-test-slave-gw5c krb5kdc[20264](info): commencing operation
krb5kdc: starting...
W20260808 10:01:58.995041 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:01:59 dist-test-slave-gw5c krb5kdc[20264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:01:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:01:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:01:59.127002 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:35899
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:35899
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:01:59.212273 20285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:59.212527 20285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:59.212551 20285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:59.213744 20285 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:01:59.213792 20285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:59.213806 20285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:59.213819 20285 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:01:59.213831 20285 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:01:59.215436 20285 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:35899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:35899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:59.215718 20285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:59.215987 20285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:59.221068 20292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:59.221061 20295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:59.221061 20293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:59.221539 20285 server_base.cc:1034] running on GCE node
I20260808 10:01:59.221819 20285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:59.222107 20285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:59.223285 20285 hybrid_clock.cc:648] HybridClock initialized: now 1786183319223257 us; error 37 us; skew 500 ppm
Aug 08 10:01:59 dist-test-slave-gw5c krb5kdc[20264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183319, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:59.228885 20285 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:01:59.229377 20285 webserver.cc:460] Webserver started at http://127.24.71.254:42227/ using document root <none> and password file <none>
I20260808 10:01:59.229619 20285 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:59.229665 20285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:59.229830 20285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:01:59.230993 20285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "c89ed268ebeb496fb528344a97f1363a"
format_stamp: "Formatted at 2026-08-08 10:01:59 on dist-test-slave-gw5c"
server_key: "b5893ebf77b48ae9afd4b36ab5091d4d"
server_key_iv: "91d096d60e9365dcd2596d9d08d69095"
server_key_version: "encryptionkey@0"
I20260808 10:01:59.231369 20285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "c89ed268ebeb496fb528344a97f1363a"
format_stamp: "Formatted at 2026-08-08 10:01:59 on dist-test-slave-gw5c"
server_key: "b5893ebf77b48ae9afd4b36ab5091d4d"
server_key_iv: "91d096d60e9365dcd2596d9d08d69095"
server_key_version: "encryptionkey@0"
I20260808 10:01:59.232811 20285 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:59.233587 20308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:59.233779 20285 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:59.233904 20285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "c89ed268ebeb496fb528344a97f1363a"
format_stamp: "Formatted at 2026-08-08 10:01:59 on dist-test-slave-gw5c"
server_key: "b5893ebf77b48ae9afd4b36ab5091d4d"
server_key_iv: "91d096d60e9365dcd2596d9d08d69095"
server_key_version: "encryptionkey@0"
I20260808 10:01:59.233994 20285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:59.245656 20285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:59.248109 20285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:59.248281 20285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:59.252486 20285 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:35899
I20260808 10:01:59.252540 20379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:35899 every 8 connection(s)
I20260808 10:01:59.252995 20285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:01:59.253906 20380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:59.256423 20380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a: Bootstrap starting.
I20260808 10:01:59.256990 20380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:59.257241 20380 log.cc:824] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:59.257934 20380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a: No bootstrap required, opened a new log
I20260808 10:01:59.259629 20380 raft_consensus.cc:348] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c89ed268ebeb496fb528344a97f1363a" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35899 } }
I20260808 10:01:59.259770 20380 raft_consensus.cc:374] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:59.259793 20380 raft_consensus.cc:729] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c89ed268ebeb496fb528344a97f1363a, State: Initialized, Role: FOLLOWER
I20260808 10:01:59.259943 20380 consensus_queue.cc:260] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c89ed268ebeb496fb528344a97f1363a" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35899 } }
I20260808 10:01:59.260022 20380 raft_consensus.cc:388] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:01:59.260046 20380 raft_consensus.cc:482] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:01:59.260074 20380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:59.260583 20380 raft_consensus.cc:504] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c89ed268ebeb496fb528344a97f1363a" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35899 } }
I20260808 10:01:59.260669 20380 leader_election.cc:302] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c89ed268ebeb496fb528344a97f1363a; no voters:
I20260808 10:01:59.260812 20380 leader_election.cc:288] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:01:59.260878 20386 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:01:59.261055 20386 raft_consensus.cc:686] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [term 1 LEADER]: Becoming Leader. State: Replica: c89ed268ebeb496fb528344a97f1363a, State: Running, Role: LEADER
I20260808 10:01:59.261107 20380 sys_catalog.cc:564] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:01:59.261147 20386 consensus_queue.cc:237] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c89ed268ebeb496fb528344a97f1363a" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35899 } }
I20260808 10:01:59.261523 20389 sys_catalog.cc:455] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c89ed268ebeb496fb528344a97f1363a. Latest consensus state: current_term: 1 leader_uuid: "c89ed268ebeb496fb528344a97f1363a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c89ed268ebeb496fb528344a97f1363a" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35899 } } }
I20260808 10:01:59.261615 20389 sys_catalog.cc:458] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [sys.catalog]: This master's current role is: LEADER
I20260808 10:01:59.261654 20387 sys_catalog.cc:455] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c89ed268ebeb496fb528344a97f1363a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c89ed268ebeb496fb528344a97f1363a" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 35899 } } }
I20260808 10:01:59.261742 20387 sys_catalog.cc:458] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a [sys.catalog]: This master's current role is: LEADER
I20260808 10:01:59.261850 20402 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:01:59.262440 20402 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:01:59.263170 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 20285
I20260808 10:01:59.263291 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:01:59.263538 24863 external_mini_cluster.cc:1428] Setting key 9fa314955d9ea0c385fe99409f233767
I20260808 10:01:59.264268 20402 catalog_manager.cc:1347] Generated new cluster ID: 4fcc973147e340d4878a2dd4e4d245c5
I20260808 10:01:59.264319 20402 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 10:01:59 dist-test-slave-gw5c krb5kdc[20264](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:01:59.279382 20430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.264057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56870 (local address 127.24.71.254:35899)
0808 10:01:59.264218 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:59.264229 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:59.267674 (+ 3445us) server_negotiation.cc:407] Connection header received
0808 10:01:59.267823 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:59.267831 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:59.267906 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:59.268082 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:59.268830 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.270759 (+ 1929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.271848 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.272503 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.272621 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.275621 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:59.275626 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:59.275626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:59.275641 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:59.277649 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:59.278089 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:59.278093 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:59.278093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:59.278205 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:59.278421 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:59.278422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:59.278422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:59.278730 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:59.278864 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:59.279008 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 10:01:59.279142 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
I20260808 10:01:59.281430 20402 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:01:59.281944 20402 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:01:59.288450 20402 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a: Generated new TSK 0
I20260808 10:01:59.288661 20402 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 10:01:59.322511 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35899
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:01:59.412889 20433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:59.413164 20433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:59.413213 20433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:59.414429 20433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:59.414503 20433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:59.414551 20433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:01:59.416177 20433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:59.416469 20433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:59.416718 20433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:59.422134 20442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:59.422152 20439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:59.422165 20440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:59.422452 20433 server_base.cc:1034] running on GCE node
I20260808 10:01:59.422639 20433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:59.422848 20433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:59.424046 20433 hybrid_clock.cc:648] HybridClock initialized: now 1786183319424033 us; error 32 us; skew 500 ppm
Aug 08 10:01:59 dist-test-slave-gw5c krb5kdc[20264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183319, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:59.426824 20433 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 10:01:59.427248 20433 webserver.cc:460] Webserver started at http://127.24.71.193:41163/ using document root <none> and password file <none>
I20260808 10:01:59.427500 20433 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:59.427549 20433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:59.427642 20433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:01:59.428808 20433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "97edebd1044041c1a819a3e8cfa6d0bc"
format_stamp: "Formatted at 2026-08-08 10:01:59 on dist-test-slave-gw5c"
server_key: "ede9b26f823eb0d2860aa0575bc615e2"
server_key_iv: "22e42915f3ebbfbe26356e24c1f64c61"
server_key_version: "encryptionkey@0"
I20260808 10:01:59.429122 20433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "97edebd1044041c1a819a3e8cfa6d0bc"
format_stamp: "Formatted at 2026-08-08 10:01:59 on dist-test-slave-gw5c"
server_key: "ede9b26f823eb0d2860aa0575bc615e2"
server_key_iv: "22e42915f3ebbfbe26356e24c1f64c61"
server_key_version: "encryptionkey@0"
I20260808 10:01:59.430519 20433 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:01:59.431272 20456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:59.431525 20433 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:59.431638 20433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "97edebd1044041c1a819a3e8cfa6d0bc"
format_stamp: "Formatted at 2026-08-08 10:01:59 on dist-test-slave-gw5c"
server_key: "ede9b26f823eb0d2860aa0575bc615e2"
server_key_iv: "22e42915f3ebbfbe26356e24c1f64c61"
server_key_version: "encryptionkey@0"
I20260808 10:01:59.431741 20433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:59.452504 20433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:59.455284 20433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:59.455511 20433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:59.455816 20433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:59.456187 20433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:01:59.456233 20433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:59.456260 20433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:01:59.456274 20433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:59.463483 20433 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:33767
I20260808 10:01:59.463522 20632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:33767 every 8 connection(s)
I20260808 10:01:59.463922 20433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 10:01:59.469246 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 20433
I20260808 10:01:59.469404 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 10:01:59.469668 24863 external_mini_cluster.cc:1428] Setting key c7c39845a8149af8ac208a7d71ec3fc8
Aug 08 10:01:59 dist-test-slave-gw5c krb5kdc[20264](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183319, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:01:59.474452 20430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.464760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:58747 (local address 127.24.71.254:35899)
0808 10:01:59.464844 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:59.464847 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:59.465115 (+ 268us) server_negotiation.cc:407] Connection header received
0808 10:01:59.465624 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:59.465625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:59.465638 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:59.465695 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:59.466677 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.467194 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.468290 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.468500 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.468558 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.471266 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:59.471268 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:59.471268 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:59.471276 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:59.472856 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:59.473400 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:59.473401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:59.473401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:59.473458 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:59.473751 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:59.473752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:59.473752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:59.473876 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:59.473928 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:59.474303 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 10:01:59.474380 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 10:01:59.474742 20637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.464731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35899 (local address 127.24.71.193:58747)
0808 10:01:59.464972 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:59.465016 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:59.465533 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:59.465751 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:59.465755 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:59.466355 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:59.466572 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.466578 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.467286 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.467287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.468201 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.468204 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.468584 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.468585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.468692 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.469244 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:01:59.469256 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:59.471162 (+ 1906us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:59.472951 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:59.472960 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:59.472962 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:59.473307 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:59.473529 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:59.473530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:59.473531 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:59.473683 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:59.473948 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:59.473955 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:59.474137 (+ 182us) client_negotiation.cc:769] Sending connection context
0808 10:01:59.474259 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 10:01:59.474452 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":124,"threads_started":1}
I20260808 10:01:59.475379 20633 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35899
I20260808 10:01:59.475528 20633 heartbeater.cc:464] Registering TS with master...
I20260808 10:01:59.475734 20633 heartbeater.cc:511] Master 127.24.71.254:35899 requested a full tablet report, sending...
I20260808 10:01:59.476316 20332 ts_manager.cc:194] Registered new tserver with Master: 97edebd1044041c1a819a3e8cfa6d0bc (127.24.71.193:33767)
I20260808 10:01:59.476963 20332 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:58747
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 10:01:59.499518 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35899
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:01:59.584273 20640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:59.584547 20640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:59.584592 20640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:59.585757 20640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:59.585835 20640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:59.585881 20640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:01:59.587368 20640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:59.587705 20640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:59.587960 20640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:59.593109 20648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:59.593212 20640 server_base.cc:1034] running on GCE node
W20260808 10:01:59.593086 20655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:59.593102 20650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:59.593595 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:59.593852 20640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:59.595063 20640 hybrid_clock.cc:648] HybridClock initialized: now 1786183319595046 us; error 33 us; skew 500 ppm
Aug 08 10:01:59 dist-test-slave-gw5c krb5kdc[20264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183319, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:59.597767 20640 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 10:01:59.598179 20640 webserver.cc:460] Webserver started at http://127.24.71.194:35715/ using document root <none> and password file <none>
I20260808 10:01:59.598381 20640 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:59.598428 20640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:59.598523 20640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:01:59.599658 20640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "2752647f72d14f8abda4ca59959c77c7"
format_stamp: "Formatted at 2026-08-08 10:01:59 on dist-test-slave-gw5c"
server_key: "16dab4c6a0e5fa8bef8811a9f5357ff9"
server_key_iv: "7c27a4e75f0ffcad7edfe9416d2c2c0f"
server_key_version: "encryptionkey@0"
I20260808 10:01:59.600075 20640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "2752647f72d14f8abda4ca59959c77c7"
format_stamp: "Formatted at 2026-08-08 10:01:59 on dist-test-slave-gw5c"
server_key: "16dab4c6a0e5fa8bef8811a9f5357ff9"
server_key_iv: "7c27a4e75f0ffcad7edfe9416d2c2c0f"
server_key_version: "encryptionkey@0"
I20260808 10:01:59.601398 20640 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:01:59.602108 20666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:59.602308 20640 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:59.602408 20640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "2752647f72d14f8abda4ca59959c77c7"
format_stamp: "Formatted at 2026-08-08 10:01:59 on dist-test-slave-gw5c"
server_key: "16dab4c6a0e5fa8bef8811a9f5357ff9"
server_key_iv: "7c27a4e75f0ffcad7edfe9416d2c2c0f"
server_key_version: "encryptionkey@0"
I20260808 10:01:59.602460 20640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:59.635164 20640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:59.637705 20640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:59.637832 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:59.638104 20640 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:59.638469 20640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:01:59.638506 20640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:59.638561 20640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:01:59.638592 20640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:59.644989 20640 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:43545
I20260808 10:01:59.645043 20846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:43545 every 8 connection(s)
I20260808 10:01:59.645387 20640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 10:01:59.646252 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 20640
I20260808 10:01:59.646380 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 10:01:59.646631 24863 external_mini_cluster.cc:1428] Setting key 3cf09eec8acfd0a1c5a23b83df1f55d3
Aug 08 10:01:59 dist-test-slave-gw5c krb5kdc[20264](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183319, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:01:59.656440 20430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.646197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:58641 (local address 127.24.71.254:35899)
0808 10:01:59.646257 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:59.646259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:59.646457 (+ 198us) server_negotiation.cc:407] Connection header received
0808 10:01:59.647118 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:59.647119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:59.647130 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:59.647186 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:59.648578 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.649089 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.650267 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.650596 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.650698 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.653340 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:59.653341 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:59.653342 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:59.653350 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:59.654833 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:59.655297 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:59.655298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:59.655299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:59.655366 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:59.655714 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:59.655715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:59.655716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:59.655847 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:59.655925 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:59.656235 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 10:01:59.656329 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
I20260808 10:01:59.656709 20849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.646077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35899 (local address 127.24.71.194:58641)
0808 10:01:59.646302 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:59.646362 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:59.647016 (+ 654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:59.647249 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:59.647252 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:59.648156 (+ 904us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:59.648461 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.648468 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.649196 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.649197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.650164 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.650167 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.650736 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.650738 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.650911 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.651490 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:01:59.651501 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:59.653221 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:59.654936 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:59.654946 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:59.654949 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:59.655208 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:59.655503 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:59.655504 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:59.655504 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:59.655633 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:59.655921 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:59.655930 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:59.656090 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 10:01:59.656202 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 10:01:59.656387 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":113,"threads_started":1}
I20260808 10:01:59.657187 20847 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35899
I20260808 10:01:59.657317 20847 heartbeater.cc:464] Registering TS with master...
I20260808 10:01:59.657519 20847 heartbeater.cc:511] Master 127.24.71.254:35899 requested a full tablet report, sending...
I20260808 10:01:59.658046 20332 ts_manager.cc:194] Registered new tserver with Master: 2752647f72d14f8abda4ca59959c77c7 (127.24.71.194:43545)
I20260808 10:01:59.658454 20332 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:58641
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 10:01:59.678457 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35899
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:01:59.765388 20853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:01:59.765594 20853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:01:59.765617 20853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:01:59.766765 20853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:01:59.766813 20853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:01:59.766839 20853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:01:59.768383 20853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:35899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:01:59.768621 20853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:01:59.768858 20853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:01:59.773990 20861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:59.773943 20859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:01:59.773955 20863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:01:59.774365 20853 server_base.cc:1034] running on GCE node
I20260808 10:01:59.774621 20853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:01:59.774873 20853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:01:59.776039 20853 hybrid_clock.cc:648] HybridClock initialized: now 1786183319776028 us; error 33 us; skew 500 ppm
Aug 08 10:01:59 dist-test-slave-gw5c krb5kdc[20264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183319, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:01:59.778774 20853 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 10:01:59.779183 20853 webserver.cc:460] Webserver started at http://127.24.71.195:42041/ using document root <none> and password file <none>
I20260808 10:01:59.779443 20853 fs_manager.cc:359] Metadata directory not provided
I20260808 10:01:59.779506 20853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:01:59.779654 20853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:01:59.780727 20853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "1464c77997444b788a4f0dfef5db2500"
format_stamp: "Formatted at 2026-08-08 10:01:59 on dist-test-slave-gw5c"
server_key: "992fd0aba80b4aee02f6485e82a3f313"
server_key_iv: "c572db6d6bd1e543d148a825f4c85db7"
server_key_version: "encryptionkey@0"
I20260808 10:01:59.781112 20853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "1464c77997444b788a4f0dfef5db2500"
format_stamp: "Formatted at 2026-08-08 10:01:59 on dist-test-slave-gw5c"
server_key: "992fd0aba80b4aee02f6485e82a3f313"
server_key_iv: "c572db6d6bd1e543d148a825f4c85db7"
server_key_version: "encryptionkey@0"
I20260808 10:01:59.782501 20853 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:01:59.783279 20871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:59.783525 20853 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:01:59.783612 20853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "1464c77997444b788a4f0dfef5db2500"
format_stamp: "Formatted at 2026-08-08 10:01:59 on dist-test-slave-gw5c"
server_key: "992fd0aba80b4aee02f6485e82a3f313"
server_key_iv: "c572db6d6bd1e543d148a825f4c85db7"
server_key_version: "encryptionkey@0"
I20260808 10:01:59.783668 20853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:01:59.810923 20853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:01:59.812971 20853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:01:59.813094 20853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:01:59.813314 20853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:01:59.813652 20853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:01:59.813687 20853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:59.813710 20853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:01:59.813755 20853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:01:59.819922 20853 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:34087
I20260808 10:01:59.820045 21052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:34087 every 8 connection(s)
I20260808 10:01:59.820346 20853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 10:01:59.824910 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 20853
I20260808 10:01:59.825029 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 10:01:59.825207 24863 external_mini_cluster.cc:1428] Setting key b305fa81822160c428dc6274a889d939
Aug 08 10:01:59 dist-test-slave-gw5c krb5kdc[20264](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183319, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:01:59.829735 20430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.821112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:44895 (local address 127.24.71.254:35899)
0808 10:01:59.821178 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:59.821180 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:59.821422 (+ 242us) server_negotiation.cc:407] Connection header received
0808 10:01:59.821962 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:59.821964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:59.821977 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:59.822033 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:59.823040 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.823633 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.824649 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.824845 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.824923 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.827263 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:59.827264 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:59.827264 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:59.827271 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:59.828573 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:59.828943 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:59.828944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:59.828944 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:59.828997 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:59.829206 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:59.829206 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:59.829206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:59.829309 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:59.829360 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:59.829603 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 10:01:59.829668 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 10:01:59.829973 21056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.821090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:35899 (local address 127.24.71.195:44895)
0808 10:01:59.821250 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:59.821308 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:59.821846 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:59.822113 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:59.822116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:59.822719 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:01:59.822930 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.822935 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.823731 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.823732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.824540 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.824542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.824936 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.824937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.825105 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.825690 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:01:59.825701 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:01:59.827172 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:01:59.828644 (+ 1472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:59.828651 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:59.828653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:59.828874 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:59.829053 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:01:59.829054 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:01:59.829054 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:01:59.829153 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:01:59.829360 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:01:59.829365 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:01:59.829491 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 10:01:59.829573 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 10:01:59.829698 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260808 10:01:59.830524 21053 heartbeater.cc:347] Connected to a master server at 127.24.71.254:35899
I20260808 10:01:59.830641 21053 heartbeater.cc:464] Registering TS with master...
I20260808 10:01:59.830830 21053 heartbeater.cc:511] Master 127.24.71.254:35899 requested a full tablet report, sending...
I20260808 10:01:59.831234 20332 ts_manager.cc:194] Registered new tserver with Master: 1464c77997444b788a4f0dfef5db2500 (127.24.71.195:34087)
I20260808 10:01:59.831660 20332 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:44895
I20260808 10:01:59.836963 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 10:01:59.844403 20430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.838310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56872 (local address 127.24.71.254:35899)
0808 10:01:59.838391 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:59.838394 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:59.838471 (+ 77us) server_negotiation.cc:407] Connection header received
0808 10:01:59.838507 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:59.838508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:59.838516 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:59.838563 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:01:59.839102 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.839648 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.840316 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.840495 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.840543 (+ 48us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.841893 (+ 1350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:01:59.841894 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:01:59.841894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:01:59.841906 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:01:59.843090 (+ 1184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:59.843516 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:59.843518 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:59.843518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:59.843575 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:01:59.843821 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:01:59.843822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:01:59.843823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:01:59.843987 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:01:59.844093 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:59.844189 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 10:01:59.844299 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 10:01:59.846122 20332 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56872:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 10:01:59.847862 20332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 10:01:59.854686 21076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.850604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44442 (local address 127.24.71.193:33767)
0808 10:01:59.850839 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:59.850844 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:59.850857 (+ 13us) server_negotiation.cc:407] Connection header received
0808 10:01:59.850903 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:59.850906 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:59.850925 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:59.851052 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:59.851333 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.852494 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.853687 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.854275 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.854372 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.854439 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:59.854554 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 10:01:59.854594 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":97,"threads_started":1}
I20260808 10:01:59.854715 21069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.850376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:33767 (local address 127.0.0.1:44442)
0808 10:01:59.850692 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:59.850703 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:59.850748 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:59.851162 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:59.851165 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:59.851167 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:59.851243 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.851245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.852630 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.852631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.853574 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.853576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.854376 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.854377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.854458 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.854472 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 10:01:59.854540 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 10:01:59.854593 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":7,"thread_start_us":53,"threads_started":1}
I20260808 10:01:59.854934 21073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.850593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:34087 (local address 127.0.0.1:41530)
0808 10:01:59.851053 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:59.851065 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:59.851121 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:59.851415 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:59.851416 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:59.851418 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:59.851471 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.851473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.852361 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.852362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.853537 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.853540 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.854474 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.854475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.854535 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.854540 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 10:01:59.854592 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 10:01:59.854637 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":99,"threads_started":1}
I20260808 10:01:59.855127 21070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.850376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:43545 (local address 127.0.0.1:44024)
0808 10:01:59.850629 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:59.850674 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:59.850748 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:59.851440 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:59.851441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:59.851443 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:59.851507 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.851509 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.852819 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.852820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.853901 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.853904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.854884 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.854886 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.854942 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.854946 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:01:59.855003 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 10:01:59.855038 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":105,"threads_started":1}
I20260808 10:01:59.855436 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.850842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41530 (local address 127.24.71.195:34087)
0808 10:01:59.851055 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:59.851059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:59.851176 (+ 117us) server_negotiation.cc:407] Connection header received
0808 10:01:59.851287 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:59.851289 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:59.851308 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:59.851383 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:59.851559 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.852256 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.853637 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.854301 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.854371 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.854426 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:59.855255 (+ 829us) server_negotiation.cc:299] Negotiation successful
0808 10:01:59.855329 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":95,"threads_started":1}
I20260808 10:01:59.855479 21072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.850493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44024 (local address 127.24.71.194:43545)
0808 10:01:59.851254 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:59.851258 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:59.851268 (+ 10us) server_negotiation.cc:407] Connection header received
0808 10:01:59.851308 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:59.851311 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:59.851327 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:59.851593 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:59.851680 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.852716 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.854001 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.854719 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.854783 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.854845 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:59.855323 (+ 478us) server_negotiation.cc:299] Negotiation successful
0808 10:01:59.855371 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":111,"threads_started":1}
I20260808 10:01:59.855566 20531 tablet_service.cc:1467] Processing CreateTablet for tablet 1c413aeccd92439ca36b2d94beae90cb (DEFAULT_TABLE table=test-table [id=4b1f1411839f420c97401481c24715e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:01:59.855999 20531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c413aeccd92439ca36b2d94beae90cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:59.856200 20737 tablet_service.cc:1467] Processing CreateTablet for tablet 1c413aeccd92439ca36b2d94beae90cb (DEFAULT_TABLE table=test-table [id=4b1f1411839f420c97401481c24715e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:01:59.856432 20951 tablet_service.cc:1467] Processing CreateTablet for tablet 1c413aeccd92439ca36b2d94beae90cb (DEFAULT_TABLE table=test-table [id=4b1f1411839f420c97401481c24715e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:01:59.856554 20737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c413aeccd92439ca36b2d94beae90cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:59.856776 20951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c413aeccd92439ca36b2d94beae90cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:01:59.859416 21081 tablet_bootstrap.cc:492] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500: Bootstrap starting.
I20260808 10:01:59.859830 21082 tablet_bootstrap.cc:492] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc: Bootstrap starting.
I20260808 10:01:59.860033 21084 tablet_bootstrap.cc:492] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7: Bootstrap starting.
I20260808 10:01:59.860423 21081 tablet_bootstrap.cc:654] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:59.860574 21082 tablet_bootstrap.cc:654] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:59.860759 21084 tablet_bootstrap.cc:654] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7: Neither blocks nor log segments found. Creating new log.
I20260808 10:01:59.861127 21082 log.cc:824] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:59.861141 21081 log.cc:824] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:59.861356 21084 log.cc:824] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7: Log is configured to *not* fsync() on all Append() calls
I20260808 10:01:59.861980 21082 tablet_bootstrap.cc:492] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc: No bootstrap required, opened a new log
I20260808 10:01:59.862057 21081 tablet_bootstrap.cc:492] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500: No bootstrap required, opened a new log
I20260808 10:01:59.862067 21082 ts_tablet_manager.cc:1397] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 10:01:59.862077 21084 tablet_bootstrap.cc:492] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7: No bootstrap required, opened a new log
I20260808 10:01:59.862133 21081 ts_tablet_manager.cc:1397] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 10:01:59.862133 21084 ts_tablet_manager.cc:1397] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 10:01:59.863746 21082 raft_consensus.cc:348] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33767 } } peers { permanent_uuid: "2752647f72d14f8abda4ca59959c77c7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43545 } } peers { permanent_uuid: "1464c77997444b788a4f0dfef5db2500" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 34087 } }
I20260808 10:01:59.863909 21082 raft_consensus.cc:374] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:59.863955 21082 raft_consensus.cc:729] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97edebd1044041c1a819a3e8cfa6d0bc, State: Initialized, Role: FOLLOWER
I20260808 10:01:59.864075 21082 consensus_queue.cc:260] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33767 } } peers { permanent_uuid: "2752647f72d14f8abda4ca59959c77c7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43545 } } peers { permanent_uuid: "1464c77997444b788a4f0dfef5db2500" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 34087 } }
I20260808 10:01:59.864130 21084 raft_consensus.cc:348] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33767 } } peers { permanent_uuid: "2752647f72d14f8abda4ca59959c77c7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43545 } } peers { permanent_uuid: "1464c77997444b788a4f0dfef5db2500" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 34087 } }
I20260808 10:01:59.864130 21081 raft_consensus.cc:348] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33767 } } peers { permanent_uuid: "2752647f72d14f8abda4ca59959c77c7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43545 } } peers { permanent_uuid: "1464c77997444b788a4f0dfef5db2500" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 34087 } }
I20260808 10:01:59.864308 21081 raft_consensus.cc:374] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:59.864308 21084 raft_consensus.cc:374] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:01:59.864354 21084 raft_consensus.cc:729] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2752647f72d14f8abda4ca59959c77c7, State: Initialized, Role: FOLLOWER
I20260808 10:01:59.864354 21081 raft_consensus.cc:729] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1464c77997444b788a4f0dfef5db2500, State: Initialized, Role: FOLLOWER
I20260808 10:01:59.864403 21082 ts_tablet_manager.cc:1428] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 10:01:59.864465 21084 consensus_queue.cc:260] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33767 } } peers { permanent_uuid: "2752647f72d14f8abda4ca59959c77c7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43545 } } peers { permanent_uuid: "1464c77997444b788a4f0dfef5db2500" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 34087 } }
I20260808 10:01:59.864465 21081 consensus_queue.cc:260] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33767 } } peers { permanent_uuid: "2752647f72d14f8abda4ca59959c77c7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43545 } } peers { permanent_uuid: "1464c77997444b788a4f0dfef5db2500" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 34087 } }
I20260808 10:01:59.864529 20633 heartbeater.cc:503] Master 127.24.71.254:35899 was elected leader, sending a full tablet report...
I20260808 10:01:59.864745 21084 ts_tablet_manager.cc:1428] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 10:01:59.864774 20847 heartbeater.cc:503] Master 127.24.71.254:35899 was elected leader, sending a full tablet report...
I20260808 10:01:59.864956 21053 heartbeater.cc:503] Master 127.24.71.254:35899 was elected leader, sending a full tablet report...
I20260808 10:01:59.864996 21081 ts_tablet_manager.cc:1428] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260808 10:01:59.895988 20848 tablet.cc:2369] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 10:01:59.964809 20634 tablet.cc:2369] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:01:59.970708 21089 raft_consensus.cc:482] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:01:59.970880 21089 raft_consensus.cc:504] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33767 } } peers { permanent_uuid: "2752647f72d14f8abda4ca59959c77c7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43545 } } peers { permanent_uuid: "1464c77997444b788a4f0dfef5db2500" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 34087 } }
I20260808 10:01:59.971292 21089 leader_election.cc:288] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2752647f72d14f8abda4ca59959c77c7 (127.24.71.194:43545), 1464c77997444b788a4f0dfef5db2500 (127.24.71.195:34087)
I20260808 10:01:59.975437 20637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.971538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:34087 (local address 127.24.71.193:47747)
0808 10:01:59.971603 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:59.971614 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:59.971657 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:59.971859 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:59.971859 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:59.971861 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:59.971983 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.971985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.972934 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.972934 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.974318 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.974322 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.975115 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.975116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.975205 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.975207 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 10:01:59.975270 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 10:01:59.975325 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":67}
I20260808 10:01:59.975471 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.971647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:47747 (local address 127.24.71.195:34087)
0808 10:01:59.971690 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:59.971692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:59.971700 (+ 8us) server_negotiation.cc:407] Connection header received
0808 10:01:59.971737 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:59.971738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:59.971764 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:59.971831 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:59.972085 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.972828 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.974423 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.975022 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.975103 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.975112 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:59.975322 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 10:01:59.975376 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 10:01:59.975471 21072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.971631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:49551 (local address 127.24.71.194:43545)
0808 10:01:59.971682 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:59.971684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:59.971803 (+ 119us) server_negotiation.cc:407] Connection header received
0808 10:01:59.971832 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:59.971833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:59.971842 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:59.971895 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:01:59.972076 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.972832 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.974423 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.975022 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.975103 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.975112 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 10:01:59.975336 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 10:01:59.975407 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 10:01:59.975445 21092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.971540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:43545 (local address 127.24.71.193:49551)
0808 10:01:59.971695 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 10:01:59.971704 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 10:01:59.971758 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:01:59.971914 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:01:59.971915 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:01:59.971916 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:01:59.972002 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.972003 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.972932 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.972933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.974319 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:01:59.974322 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.975115 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:01:59.975116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:01:59.975200 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:01:59.975205 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 10:01:59.975270 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 10:01:59.975341 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":131,"thread_start_us":88,"threads_started":1}
I20260808 10:01:59.975867 20983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c413aeccd92439ca36b2d94beae90cb" candidate_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1464c77997444b788a4f0dfef5db2500" is_pre_election: true
I20260808 10:01:59.976049 20983 raft_consensus.cc:2454] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97edebd1044041c1a819a3e8cfa6d0bc in term 0.
I20260808 10:01:59.976053 20773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c413aeccd92439ca36b2d94beae90cb" candidate_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2752647f72d14f8abda4ca59959c77c7" is_pre_election: true
I20260808 10:01:59.976230 20773 raft_consensus.cc:2454] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97edebd1044041c1a819a3e8cfa6d0bc in term 0.
I20260808 10:01:59.976341 20461 leader_election.cc:302] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1464c77997444b788a4f0dfef5db2500, 97edebd1044041c1a819a3e8cfa6d0bc; no voters:
I20260808 10:01:59.976534 21089 raft_consensus.cc:2781] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 10:01:59.976615 21089 raft_consensus.cc:482] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 10:01:59.976650 21089 raft_consensus.cc:3037] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:59.977424 21089 raft_consensus.cc:504] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33767 } } peers { permanent_uuid: "2752647f72d14f8abda4ca59959c77c7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43545 } } peers { permanent_uuid: "1464c77997444b788a4f0dfef5db2500" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 34087 } }
I20260808 10:01:59.977592 21089 leader_election.cc:288] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [CANDIDATE]: Term 1 election: Requested vote from peers 2752647f72d14f8abda4ca59959c77c7 (127.24.71.194:43545), 1464c77997444b788a4f0dfef5db2500 (127.24.71.195:34087)
I20260808 10:01:59.977728 20773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c413aeccd92439ca36b2d94beae90cb" candidate_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2752647f72d14f8abda4ca59959c77c7"
I20260808 10:01:59.977766 20983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c413aeccd92439ca36b2d94beae90cb" candidate_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1464c77997444b788a4f0dfef5db2500"
I20260808 10:01:59.977835 20773 raft_consensus.cc:3037] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:59.977829 20983 raft_consensus.cc:3037] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:01:59.978580 20773 raft_consensus.cc:2454] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97edebd1044041c1a819a3e8cfa6d0bc in term 1.
I20260808 10:01:59.978590 20983 raft_consensus.cc:2454] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97edebd1044041c1a819a3e8cfa6d0bc in term 1.
I20260808 10:01:59.978765 20465 leader_election.cc:302] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2752647f72d14f8abda4ca59959c77c7, 97edebd1044041c1a819a3e8cfa6d0bc; no voters:
I20260808 10:01:59.978852 21089 raft_consensus.cc:2781] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:01:59.979048 21089 raft_consensus.cc:686] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [term 1 LEADER]: Becoming Leader. State: Replica: 97edebd1044041c1a819a3e8cfa6d0bc, State: Running, Role: LEADER
I20260808 10:01:59.979177 21089 consensus_queue.cc:237] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33767 } } peers { permanent_uuid: "2752647f72d14f8abda4ca59959c77c7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43545 } } peers { permanent_uuid: "1464c77997444b788a4f0dfef5db2500" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 34087 } }
I20260808 10:01:59.980131 20332 catalog_manager.cc:5495] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 97edebd1044041c1a819a3e8cfa6d0bc (127.24.71.193). New cstate: current_term: 1 leader_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97edebd1044041c1a819a3e8cfa6d0bc" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 33767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2752647f72d14f8abda4ca59959c77c7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1464c77997444b788a4f0dfef5db2500" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 34087 } health_report { overall_health: UNKNOWN } } }
I20260808 10:02:00.001857 21076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:01:59.998674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44458 (local address 127.24.71.193:33767)
0808 10:01:59.998744 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 10:01:59.998748 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 10:01:59.998761 (+ 13us) server_negotiation.cc:407] Connection header received
0808 10:01:59.998799 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:01:59.998800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:01:59.998821 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:01:59.998882 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:01:59.999028 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:01:59.999601 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.000480 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.000803 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.000894 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.001206 (+ 312us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:00.001345 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:00.001584 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:00.001714 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 10:02:00.001729 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 10:02:00.004246 20983 raft_consensus.cc:1261] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500 [term 1 FOLLOWER]: Refusing update from remote peer 97edebd1044041c1a819a3e8cfa6d0bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:02:00.004319 20773 raft_consensus.cc:1261] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7 [term 1 FOLLOWER]: Refusing update from remote peer 97edebd1044041c1a819a3e8cfa6d0bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:02:00.004666 21093 consensus_queue.cc:1035] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1464c77997444b788a4f0dfef5db2500" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 34087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:02:00.004824 21089 consensus_queue.cc:1035] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2752647f72d14f8abda4ca59959c77c7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:02:00.008224 21100 mvcc.cc:205] Tried to move back new op lower bound from 7316206878734331904 to 7316206878635433984. Current Snapshot: MvccSnapshot[applied={T|T < 7316206878734331904}]
I20260808 10:02:00.009804 20332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:02:00.009897 20332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:02:00.010649 20332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c89ed268ebeb496fb528344a97f1363a: Sending DeleteTablet for 3 replicas of tablet 1c413aeccd92439ca36b2d94beae90cb
I20260808 10:02:00.011057 20951 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c413aeccd92439ca36b2d94beae90cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:02:00 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:41530
I20260808 10:02:00.011058 20737 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c413aeccd92439ca36b2d94beae90cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:02:00 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:44024
I20260808 10:02:00.011304 21114 tablet_replica.cc:330] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500: stopping tablet replica
I20260808 10:02:00.011427 21114 raft_consensus.cc:2229] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:02:00.011423 20531 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c413aeccd92439ca36b2d94beae90cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:02:00 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:44442
I20260808 10:02:00.011544 21114 raft_consensus.cc:2258] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:02:00.011664 21116 tablet_replica.cc:330] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc: stopping tablet replica
I20260808 10:02:00.011771 21116 raft_consensus.cc:2229] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [term 1 LEADER]: Raft consensus shutting down.
I20260808 10:02:00.011868 21116 raft_consensus.cc:2258] T 1c413aeccd92439ca36b2d94beae90cb P 97edebd1044041c1a819a3e8cfa6d0bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:02:00.011888 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 20433
I20260808 10:02:00.012359 21114 ts_tablet_manager.cc:1905] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:02:00.015223 21114 ts_tablet_manager.cc:1918] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:02:00.015426 21114 log.cc:1196] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/1c413aeccd92439ca36b2d94beae90cb
I20260808 10:02:00.015837 21114 ts_tablet_manager.cc:1939] T 1c413aeccd92439ca36b2d94beae90cb P 1464c77997444b788a4f0dfef5db2500: Deleting consensus metadata
I20260808 10:02:00.017377 20310 catalog_manager.cc:4841] TS 1464c77997444b788a4f0dfef5db2500 (127.24.71.195:34087): tablet 1c413aeccd92439ca36b2d94beae90cb (table test-table [id=4b1f1411839f420c97401481c24715e1]) successfully deleted
I20260808 10:02:00.018837 21112 tablet_replica.cc:330] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7: stopping tablet replica
I20260808 10:02:00.019004 21112 raft_consensus.cc:2229] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:02:00.019152 21112 raft_consensus.cc:2258] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:02:00.019644 21112 ts_tablet_manager.cc:1905] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:02:00.020983 21112 ts_tablet_manager.cc:1918] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:02:00.021047 21112 log.cc:1196] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/1c413aeccd92439ca36b2d94beae90cb
I20260808 10:02:00.021323 21112 ts_tablet_manager.cc:1939] T 1c413aeccd92439ca36b2d94beae90cb P 2752647f72d14f8abda4ca59959c77c7: Deleting consensus metadata
I20260808 10:02:00.021790 20312 catalog_manager.cc:4841] TS 2752647f72d14f8abda4ca59959c77c7 (127.24.71.194:43545): tablet 1c413aeccd92439ca36b2d94beae90cb (table test-table [id=4b1f1411839f420c97401481c24715e1]) successfully deleted
W20260808 10:02:00.023705 20310 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:33767 (error 108)
I20260808 10:02:00.023924 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 20640
I20260808 10:02:00.026134 21070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.024126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:33767 (local address 127.0.0.1:44468)
0808 10:02:00.026044 (+ 1918us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:00.026088 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:33767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1894}
W20260808 10:02:00.035830 20310 catalog_manager.cc:4584] TS 97edebd1044041c1a819a3e8cfa6d0bc (127.24.71.193:33767): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1c413aeccd92439ca36b2d94beae90cb: Network error: Client connection negotiation failed: client connection to 127.24.71.193:33767: connect: Connection refused (error 111)
I20260808 10:02:00.040110 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 20853
I20260808 10:02:00.058135 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 20285
2026-08-08T10:02:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2392 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T10:02:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:00Z Disabled control of system clock
I20260808 10:02:00.095594 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:40079
--webserver_interface=127.24.71.254
--webserver_port=0
--builtin_ntp_servers=127.24.71.212:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:40079
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 10:02:00.179278 21126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:00.179566 21126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:00.179591 21126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:00.180783 21126 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:00.180825 21126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:00.180838 21126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:00.180851 21126 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:00.180903 21126 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:00.182312 21126 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:40079
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:40079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:00.182580 21126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:00.182900 21126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:00.187996 21134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:00.188011 21132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:00.188089 21126 server_base.cc:1034] running on GCE node
W20260808 10:02:00.188014 21137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:00.188445 21126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:00.188757 21126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:00.189961 21126 hybrid_clock.cc:648] HybridClock initialized: now 1786183320189935 us; error 41 us; skew 500 ppm
I20260808 10:02:00.191325 21126 webserver.cc:460] Webserver started at http://127.24.71.254:37553/ using document root <none> and password file <none>
I20260808 10:02:00.191610 21126 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:00.191687 21126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:00.191855 21126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:00.192945 21126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "36373e80e17c4dd1906275604112c9bf"
format_stamp: "Formatted at 2026-08-08 10:02:00 on dist-test-slave-gw5c"
server_key: "5bb1a887bb19dcba795801b197307a30"
server_key_iv: "dad25ade742e257739cdcb19ac86c92a"
server_key_version: "encryptionkey@0"
I20260808 10:02:00.193334 21126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "36373e80e17c4dd1906275604112c9bf"
format_stamp: "Formatted at 2026-08-08 10:02:00 on dist-test-slave-gw5c"
server_key: "5bb1a887bb19dcba795801b197307a30"
server_key_iv: "dad25ade742e257739cdcb19ac86c92a"
server_key_version: "encryptionkey@0"
I20260808 10:02:00.194731 21126 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:02:00.195497 21145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:00.195683 21126 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:02:00.195796 21126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "36373e80e17c4dd1906275604112c9bf"
format_stamp: "Formatted at 2026-08-08 10:02:00 on dist-test-slave-gw5c"
server_key: "5bb1a887bb19dcba795801b197307a30"
server_key_iv: "dad25ade742e257739cdcb19ac86c92a"
server_key_version: "encryptionkey@0"
I20260808 10:02:00.195880 21126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:00.215209 21126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:00.215652 21126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:00.215832 21126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:00.220513 21126 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:40079
I20260808 10:02:00.220567 21233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:40079 every 8 connection(s)
I20260808 10:02:00.220973 21126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:00.222005 21234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:00.224436 21234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf: Bootstrap starting.
I20260808 10:02:00.225093 21234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:00.225415 21234 log.cc:824] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:00.226188 21234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf: No bootstrap required, opened a new log
I20260808 10:02:00.227821 21234 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36373e80e17c4dd1906275604112c9bf" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40079 } }
I20260808 10:02:00.227967 21234 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:00.227991 21234 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36373e80e17c4dd1906275604112c9bf, State: Initialized, Role: FOLLOWER
I20260808 10:02:00.228170 21234 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36373e80e17c4dd1906275604112c9bf" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40079 } }
I20260808 10:02:00.228235 21234 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:00.228278 21234 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:00.228329 21234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:00.228848 21234 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36373e80e17c4dd1906275604112c9bf" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40079 } }
I20260808 10:02:00.228976 21234 leader_election.cc:302] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36373e80e17c4dd1906275604112c9bf; no voters:
I20260808 10:02:00.229162 21234 leader_election.cc:288] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:00.229216 21237 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:00.229434 21234 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:00.229478 21237 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [term 1 LEADER]: Becoming Leader. State: Replica: 36373e80e17c4dd1906275604112c9bf, State: Running, Role: LEADER
I20260808 10:02:00.229595 21237 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36373e80e17c4dd1906275604112c9bf" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40079 } }
I20260808 10:02:00.230055 21240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36373e80e17c4dd1906275604112c9bf. Latest consensus state: current_term: 1 leader_uuid: "36373e80e17c4dd1906275604112c9bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36373e80e17c4dd1906275604112c9bf" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40079 } } }
I20260808 10:02:00.230144 21240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:00.230248 21238 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36373e80e17c4dd1906275604112c9bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36373e80e17c4dd1906275604112c9bf" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 40079 } } }
I20260808 10:02:00.230381 21238 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:00.230559 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 21126
I20260808 10:02:00.230593 21252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:00.230700 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:00.230892 24863 external_mini_cluster.cc:1428] Setting key 719b82ad9133f69053722b9bbd1a501a
I20260808 10:02:00.231133 21252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:00.232928 21252 catalog_manager.cc:1347] Generated new cluster ID: ed9fc88638be4e9b9f8e9a4467cd2c8f
I20260808 10:02:00.232985 21252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:00.237659 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.231710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42884 (local address 127.24.71.254:40079)
0808 10:02:00.232248 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:00.232255 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:00.232275 (+ 20us) server_negotiation.cc:407] Connection header received
0808 10:02:00.232406 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:00.232415 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:00.232515 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:00.232672 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:00.232979 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.234323 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.235429 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.236089 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.236226 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.236952 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:00.236956 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:00.236957 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:00.237171 (+ 214us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:00.237212 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:00.237228 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:00.237303 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:00.237367 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 10:02:00.237444 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":79,"threads_started":1}
I20260808 10:02:00.250142 21252 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:00.250859 21252 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:00.256636 21252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf: Generated new TSK 0
I20260808 10:02:00.256850 21252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:00.259610 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:40079
--builtin_ntp_servers=127.24.71.212:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 10:02:00.343828 21273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:00.344062 21273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:00.344101 21273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:00.345309 21273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:00.345366 21273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:00.345415 21273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:02:00.346763 21273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:40079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21273
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:00.347034 21273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:00.347340 21273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:00.353464 21281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:00.353469 21279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:00.353688 21273 server_base.cc:1034] running on GCE node
W20260808 10:02:00.353530 21284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:00.354102 21273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:00.354404 21273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:00.355572 21273 hybrid_clock.cc:648] HybridClock initialized: now 1786183320355548 us; error 39 us; skew 500 ppm
I20260808 10:02:00.357247 21273 webserver.cc:460] Webserver started at http://127.24.71.193:41441/ using document root <none> and password file <none>
I20260808 10:02:00.357556 21273 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:00.357626 21273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:00.357780 21273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:00.359220 21273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "e3f762660d1b4794b62d1f7ef1c07edb"
format_stamp: "Formatted at 2026-08-08 10:02:00 on dist-test-slave-gw5c"
server_key: "061bf8ae72d6c7bea80bdaa6b664925b"
server_key_iv: "e828625d89768a01a4bbb44f118f8bc5"
server_key_version: "encryptionkey@0"
I20260808 10:02:00.359663 21273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "e3f762660d1b4794b62d1f7ef1c07edb"
format_stamp: "Formatted at 2026-08-08 10:02:00 on dist-test-slave-gw5c"
server_key: "061bf8ae72d6c7bea80bdaa6b664925b"
server_key_iv: "e828625d89768a01a4bbb44f118f8bc5"
server_key_version: "encryptionkey@0"
I20260808 10:02:00.361244 21273 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:02:00.362112 21291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:00.362304 21273 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:00.362403 21273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "e3f762660d1b4794b62d1f7ef1c07edb"
format_stamp: "Formatted at 2026-08-08 10:02:00 on dist-test-slave-gw5c"
server_key: "061bf8ae72d6c7bea80bdaa6b664925b"
server_key_iv: "e828625d89768a01a4bbb44f118f8bc5"
server_key_version: "encryptionkey@0"
I20260808 10:02:00.362464 21273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:00.375847 21273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:00.376183 21273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:00.376330 21273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:00.376571 21273 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:02:00.376909 21273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:02:00.376962 21273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:00.377004 21273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:02:00.377028 21273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:00.383019 21273 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:40691
I20260808 10:02:00.383153 21477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:40691 every 8 connection(s)
I20260808 10:02:00.383500 21273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 10:02:00.385782 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 21273
I20260808 10:02:00.385906 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 10:02:00.386123 24863 external_mini_cluster.cc:1428] Setting key 2c31d28458fced948221f08c9c4eb871
I20260808 10:02:00.387183 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:40079
--builtin_ntp_servers=127.24.71.212:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 10:02:00.389807 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.384353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:59737 (local address 127.24.71.254:40079)
0808 10:02:00.384426 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:00.384428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:00.384718 (+ 290us) server_negotiation.cc:407] Connection header received
0808 10:02:00.385251 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:00.385252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:00.385265 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:00.385310 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:00.386062 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.386788 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.388023 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.388336 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.388423 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.389463 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:00.389464 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:00.389465 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:00.389471 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:00.389488 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:00.389493 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:00.389570 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:00.389673 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 10:02:00.389709 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 10:02:00.390054 21482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.384340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:40079 (local address 127.24.71.193:59737)
0808 10:02:00.384581 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:00.384627 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:00.385151 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:00.385366 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:00.385370 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:00.385378 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:00.385951 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.385958 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.386891 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.386892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.387903 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.387907 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.388434 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.388435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.388584 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.389266 (+ 682us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 10:02:00.389267 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:00.389334 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 10:02:00.389360 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:00.389573 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:00.389581 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:00.389584 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 10:02:00.389676 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 10:02:00.389787 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":122,"threads_started":1}
I20260808 10:02:00.390542 21478 heartbeater.cc:347] Connected to a master server at 127.24.71.254:40079
I20260808 10:02:00.390640 21478 heartbeater.cc:464] Registering TS with master...
I20260808 10:02:00.390856 21478 heartbeater.cc:511] Master 127.24.71.254:40079 requested a full tablet report, sending...
I20260808 10:02:00.391431 21172 ts_manager.cc:194] Registered new tserver with Master: e3f762660d1b4794b62d1f7ef1c07edb (127.24.71.193:40691)
I20260808 10:02:00.392156 21172 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.71.193:59737
W20260808 10:02:00.473785 21484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:00.474052 21484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:00.474104 21484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:00.475286 21484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:00.475353 21484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:00.475394 21484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:02:00.476863 21484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:40079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:00.477146 21484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:00.477471 21484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:00.482754 21492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:00.482733 21491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:00.482723 21494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:00.483466 21484 server_base.cc:1034] running on GCE node
I20260808 10:02:00.483745 21484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:00.483994 21484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:00.485163 21484 hybrid_clock.cc:648] HybridClock initialized: now 1786183320485149 us; error 49 us; skew 500 ppm
I20260808 10:02:00.486421 21484 webserver.cc:460] Webserver started at http://127.24.71.194:39011/ using document root <none> and password file <none>
I20260808 10:02:00.486681 21484 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:00.486753 21484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:00.486919 21484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:00.488077 21484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "2a8065617fc745b9ac082d470875f81a"
format_stamp: "Formatted at 2026-08-08 10:02:00 on dist-test-slave-gw5c"
server_key: "6fd8b0c047a551b13da752143e853ae8"
server_key_iv: "26cf62283eec0885cf2b33087abc57de"
server_key_version: "encryptionkey@0"
I20260808 10:02:00.488445 21484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "2a8065617fc745b9ac082d470875f81a"
format_stamp: "Formatted at 2026-08-08 10:02:00 on dist-test-slave-gw5c"
server_key: "6fd8b0c047a551b13da752143e853ae8"
server_key_iv: "26cf62283eec0885cf2b33087abc57de"
server_key_version: "encryptionkey@0"
I20260808 10:02:00.489899 21484 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:02:00.490617 21502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:00.490794 21484 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:02:00.490904 21484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "2a8065617fc745b9ac082d470875f81a"
format_stamp: "Formatted at 2026-08-08 10:02:00 on dist-test-slave-gw5c"
server_key: "6fd8b0c047a551b13da752143e853ae8"
server_key_iv: "26cf62283eec0885cf2b33087abc57de"
server_key_version: "encryptionkey@0"
I20260808 10:02:00.490988 21484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:00.508169 21484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:00.508546 21484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:00.508723 21484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:00.509001 21484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:02:00.509413 21484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:02:00.509475 21484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:00.509527 21484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:02:00.509562 21484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:00.516559 21484 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:40719
I20260808 10:02:00.516621 21686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:40719 every 8 connection(s)
I20260808 10:02:00.517040 21484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 10:02:00.522555 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.517960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:33933 (local address 127.24.71.254:40079)
0808 10:02:00.518029 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:00.518032 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:00.518250 (+ 218us) server_negotiation.cc:407] Connection header received
0808 10:02:00.518811 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:00.518812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:00.518826 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:00.518882 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:00.519641 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.520148 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.521142 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.521332 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.521415 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.522249 (+ 834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:00.522250 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:00.522251 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:00.522257 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:00.522275 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:00.522279 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:00.522338 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:00.522439 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 10:02:00.522473 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 10:02:00.522773 21691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.517927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:40079 (local address 127.24.71.194:33933)
0808 10:02:00.518120 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:00.518155 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:00.518697 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:00.518956 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:00.518960 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:00.518985 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:00.519538 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.519543 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.520247 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.520249 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.521043 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.521045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.521424 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.521425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.521561 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.522108 (+ 547us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 10:02:00.522108 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:00.522136 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 10:02:00.522159 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:00.522338 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:00.522345 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:00.522348 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 10:02:00.522430 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 10:02:00.522532 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260808 10:02:00.523383 21687 heartbeater.cc:347] Connected to a master server at 127.24.71.254:40079
I20260808 10:02:00.523524 21687 heartbeater.cc:464] Registering TS with master...
I20260808 10:02:00.523525 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 21484
I20260808 10:02:00.523622 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 10:02:00.523742 21687 heartbeater.cc:511] Master 127.24.71.254:40079 requested a full tablet report, sending...
I20260808 10:02:00.523845 24863 external_mini_cluster.cc:1428] Setting key 45f29aea6d8f7b9b178d783e14af10c2
I20260808 10:02:00.524221 21172 ts_manager.cc:194] Registered new tserver with Master: 2a8065617fc745b9ac082d470875f81a (127.24.71.194:40719)
I20260808 10:02:00.524744 21172 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.71.194:33933
I20260808 10:02:00.524915 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:40079
--builtin_ntp_servers=127.24.71.212:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 10:02:00.610595 21695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:00.610821 21695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:00.610843 21695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:00.612112 21695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:00.612159 21695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:00.612185 21695 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:02:00.613544 21695 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:40079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:00.613797 21695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:00.614106 21695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:00.619261 21708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:00.619311 21704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:00.619449 21695 server_base.cc:1034] running on GCE node
W20260808 10:02:00.619580 21706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:00.619881 21695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:00.620179 21695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:00.621340 21695 hybrid_clock.cc:648] HybridClock initialized: now 1786183320621323 us; error 34 us; skew 500 ppm
I20260808 10:02:00.622750 21695 webserver.cc:460] Webserver started at http://127.24.71.195:39919/ using document root <none> and password file <none>
I20260808 10:02:00.623019 21695 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:00.623092 21695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:00.623252 21695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:00.624439 21695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "28821b5303ac4dceb64c9a0abc3ddcc0"
format_stamp: "Formatted at 2026-08-08 10:02:00 on dist-test-slave-gw5c"
server_key: "44c96b8b3c85b58beb0a477d56293f0b"
server_key_iv: "71d97a9e3129b6b2f04c8a1bc1beae68"
server_key_version: "encryptionkey@0"
I20260808 10:02:00.624820 21695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "28821b5303ac4dceb64c9a0abc3ddcc0"
format_stamp: "Formatted at 2026-08-08 10:02:00 on dist-test-slave-gw5c"
server_key: "44c96b8b3c85b58beb0a477d56293f0b"
server_key_iv: "71d97a9e3129b6b2f04c8a1bc1beae68"
server_key_version: "encryptionkey@0"
I20260808 10:02:00.626227 21695 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 10:02:00.627022 21718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:00.627209 21695 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:00.627319 21695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "28821b5303ac4dceb64c9a0abc3ddcc0"
format_stamp: "Formatted at 2026-08-08 10:02:00 on dist-test-slave-gw5c"
server_key: "44c96b8b3c85b58beb0a477d56293f0b"
server_key_iv: "71d97a9e3129b6b2f04c8a1bc1beae68"
server_key_version: "encryptionkey@0"
I20260808 10:02:00.627589 21695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:00.639081 21695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:00.639482 21695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:00.639642 21695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:00.639878 21695 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:02:00.640221 21695 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:02:00.640285 21695 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:00.640327 21695 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:02:00.640355 21695 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:00.646330 21695 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:35955
I20260808 10:02:00.646378 21899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:35955 every 8 connection(s)
I20260808 10:02:00.646715 21695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 10:02:00.650679 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 21695
I20260808 10:02:00.650799 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 10:02:00.651000 24863 external_mini_cluster.cc:1428] Setting key 6ee341a116af9fa1c1206d577c031521
I20260808 10:02:00.652346 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.647457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:40745 (local address 127.24.71.254:40079)
0808 10:02:00.647506 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:00.647508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:00.647841 (+ 333us) server_negotiation.cc:407] Connection header received
0808 10:02:00.648397 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:00.648398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:00.648412 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:00.648472 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:00.649198 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.649711 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.650713 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.650975 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.651063 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.652073 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:00.652075 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:00.652075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:00.652081 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:00.652100 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:00.652105 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:00.652166 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:00.652261 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 10:02:00.652288 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 10:02:00.652558 21903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.647478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:40079 (local address 127.24.71.195:40745)
0808 10:02:00.647697 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:00.647733 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:00.648284 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:00.648540 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:00.648544 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:00.648554 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:00.649095 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.649100 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.649819 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.649820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.650613 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.650615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.651077 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.651078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.651214 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.651902 (+ 688us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 10:02:00.651903 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:00.651931 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 10:02:00.651954 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:00.652179 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:00.652185 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:00.652188 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 10:02:00.652256 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 10:02:00.652345 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":94,"threads_started":1}
I20260808 10:02:00.653034 21900 heartbeater.cc:347] Connected to a master server at 127.24.71.254:40079
I20260808 10:02:00.653152 21900 heartbeater.cc:464] Registering TS with master...
I20260808 10:02:00.653425 21900 heartbeater.cc:511] Master 127.24.71.254:40079 requested a full tablet report, sending...
I20260808 10:02:00.653797 21172 ts_manager.cc:194] Registered new tserver with Master: 28821b5303ac4dceb64c9a0abc3ddcc0 (127.24.71.195:35955)
I20260808 10:02:00.654188 21172 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.71.195:40745
I20260808 10:02:00.663326 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 10:02:00.668174 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.664911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42900 (local address 127.24.71.254:40079)
0808 10:02:00.664999 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:00.665002 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:00.665094 (+ 92us) server_negotiation.cc:407] Connection header received
0808 10:02:00.665170 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:00.665171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:00.665191 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:00.665255 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:00.665445 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.666003 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.666776 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.666973 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.667050 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.667833 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:00.667834 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:00.667834 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:00.667840 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:00.667856 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:00.667860 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:00.667981 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:00.668070 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 10:02:00.668083 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 10:02:00.669765 21172 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42900:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 10:02:00.671334 21172 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 10:02:00.677764 21923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.674037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57868 (local address 127.24.71.193:40691)
0808 10:02:00.674213 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:00.674218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:00.674228 (+ 10us) server_negotiation.cc:407] Connection header received
0808 10:02:00.674270 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:00.674272 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:00.674289 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:00.674553 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:00.674623 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.675300 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.676815 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.677357 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.677448 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.677555 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:00.677630 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 10:02:00.677672 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":103,"threads_started":1}
I20260808 10:02:00.677752 21909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.673483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:40691 (local address 127.0.0.1:57868)
0808 10:02:00.673782 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:00.673794 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:00.673850 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:00.674411 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:00.674412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:00.674414 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:00.674466 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.674468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.675413 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.675414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.676710 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.676713 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.677448 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.677449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.677524 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.677536 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 10:02:00.677615 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 10:02:00.677675 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":58,"thread_start_us":127,"threads_started":1}
I20260808 10:02:00.677983 21916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.673470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:35955 (local address 127.0.0.1:51134)
0808 10:02:00.673666 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:00.673696 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:00.673785 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:00.674259 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:00.674263 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:00.674268 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:00.674354 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.674356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.675742 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.675743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.676661 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.676664 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.677725 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.677726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.677790 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.677794 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:02:00.677846 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 10:02:00.677894 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":4,"thread_start_us":64,"threads_started":1}
I20260808 10:02:00.678155 21920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.673792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36112 (local address 127.24.71.194:40719)
0808 10:02:00.674002 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:00.674007 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:00.674019 (+ 12us) server_negotiation.cc:407] Connection header received
0808 10:02:00.674065 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:00.674068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:00.674085 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:00.674169 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:00.674460 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.675626 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.676888 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.677578 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.677638 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.677717 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:00.678030 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 10:02:00.678075 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":122,"threads_started":1}
I20260808 10:02:00.678215 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.673796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51134 (local address 127.24.71.195:35955)
0808 10:02:00.674040 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:00.674043 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:00.674054 (+ 11us) server_negotiation.cc:407] Connection header received
0808 10:02:00.674094 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:00.674095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:00.674112 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:00.674182 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:00.674443 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.675655 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.676757 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.677505 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.677579 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.677683 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:00.678077 (+ 394us) server_negotiation.cc:299] Negotiation successful
0808 10:02:00.678124 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":121,"threads_started":1}
I20260808 10:02:00.677982 21917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.673483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:40719 (local address 127.0.0.1:36112)
0808 10:02:00.673908 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:00.673918 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:00.673958 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:00.674259 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:00.674263 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:00.674265 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:00.674355 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.674356 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.675721 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.675722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.676808 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.676810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.677747 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.677748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.677796 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.677799 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 10:02:00.677846 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 10:02:00.677896 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":36,"thread_start_us":123,"threads_started":1}
I20260808 10:02:00.678928 21371 tablet_service.cc:1467] Processing CreateTablet for tablet 4a261b58f2f349a2881976c992085cb1 (DEFAULT_TABLE table=test-table [id=0844e48c84f64cd1b51d9f50d587d2b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:02:00.678920 21799 tablet_service.cc:1467] Processing CreateTablet for tablet 4a261b58f2f349a2881976c992085cb1 (DEFAULT_TABLE table=test-table [id=0844e48c84f64cd1b51d9f50d587d2b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:02:00.679206 21585 tablet_service.cc:1467] Processing CreateTablet for tablet 4a261b58f2f349a2881976c992085cb1 (DEFAULT_TABLE table=test-table [id=0844e48c84f64cd1b51d9f50d587d2b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:02:00.679342 21371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a261b58f2f349a2881976c992085cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:00.679342 21799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a261b58f2f349a2881976c992085cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:00.679593 21585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a261b58f2f349a2881976c992085cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:00.682199 21924 tablet_bootstrap.cc:492] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a: Bootstrap starting.
I20260808 10:02:00.682796 21926 tablet_bootstrap.cc:492] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb: Bootstrap starting.
I20260808 10:02:00.683209 21924 tablet_bootstrap.cc:654] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:00.683553 21926 tablet_bootstrap.cc:654] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:00.683547 21925 tablet_bootstrap.cc:492] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0: Bootstrap starting.
I20260808 10:02:00.683596 21924 log.cc:824] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:00.683893 21926 log.cc:824] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:00.684242 21925 tablet_bootstrap.cc:654] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:00.684453 21924 tablet_bootstrap.cc:492] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a: No bootstrap required, opened a new log
I20260808 10:02:00.684535 21924 ts_tablet_manager.cc:1397] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 10:02:00.684566 21925 log.cc:824] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:00.685307 21925 tablet_bootstrap.cc:492] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0: No bootstrap required, opened a new log
I20260808 10:02:00.685359 21925 ts_tablet_manager.cc:1397] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 10:02:00.686650 21924 raft_consensus.cc:348] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35955 } } peers { permanent_uuid: "e3f762660d1b4794b62d1f7ef1c07edb" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 40691 } } peers { permanent_uuid: "2a8065617fc745b9ac082d470875f81a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40719 } }
I20260808 10:02:00.686844 21924 raft_consensus.cc:374] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:00.686902 21924 raft_consensus.cc:729] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a8065617fc745b9ac082d470875f81a, State: Initialized, Role: FOLLOWER
I20260808 10:02:00.687026 21924 consensus_queue.cc:260] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35955 } } peers { permanent_uuid: "e3f762660d1b4794b62d1f7ef1c07edb" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 40691 } } peers { permanent_uuid: "2a8065617fc745b9ac082d470875f81a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40719 } }
I20260808 10:02:00.687299 21924 ts_tablet_manager.cc:1428] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 10:02:00.687354 21687 heartbeater.cc:503] Master 127.24.71.254:40079 was elected leader, sending a full tablet report...
I20260808 10:02:00.687727 21925 raft_consensus.cc:348] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35955 } } peers { permanent_uuid: "e3f762660d1b4794b62d1f7ef1c07edb" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 40691 } } peers { permanent_uuid: "2a8065617fc745b9ac082d470875f81a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40719 } }
I20260808 10:02:00.687870 21925 raft_consensus.cc:374] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:00.687923 21925 raft_consensus.cc:729] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28821b5303ac4dceb64c9a0abc3ddcc0, State: Initialized, Role: FOLLOWER
I20260808 10:02:00.687943 21926 tablet_bootstrap.cc:492] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb: No bootstrap required, opened a new log
I20260808 10:02:00.688005 21926 ts_tablet_manager.cc:1397] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260808 10:02:00.688061 21925 consensus_queue.cc:260] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35955 } } peers { permanent_uuid: "e3f762660d1b4794b62d1f7ef1c07edb" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 40691 } } peers { permanent_uuid: "2a8065617fc745b9ac082d470875f81a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40719 } }
I20260808 10:02:00.688297 21925 ts_tablet_manager.cc:1428] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 10:02:00.688364 21900 heartbeater.cc:503] Master 127.24.71.254:40079 was elected leader, sending a full tablet report...
I20260808 10:02:00.690419 21926 raft_consensus.cc:348] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35955 } } peers { permanent_uuid: "e3f762660d1b4794b62d1f7ef1c07edb" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 40691 } } peers { permanent_uuid: "2a8065617fc745b9ac082d470875f81a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40719 } }
I20260808 10:02:00.690541 21926 raft_consensus.cc:374] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:00.690562 21926 raft_consensus.cc:729] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f762660d1b4794b62d1f7ef1c07edb, State: Initialized, Role: FOLLOWER
I20260808 10:02:00.690635 21926 consensus_queue.cc:260] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35955 } } peers { permanent_uuid: "e3f762660d1b4794b62d1f7ef1c07edb" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 40691 } } peers { permanent_uuid: "2a8065617fc745b9ac082d470875f81a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40719 } }
I20260808 10:02:00.690822 21926 ts_tablet_manager.cc:1428] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 10:02:00.690889 21478 heartbeater.cc:503] Master 127.24.71.254:40079 was elected leader, sending a full tablet report...
I20260808 10:02:00.756671 21932 raft_consensus.cc:482] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:02:00.756809 21932 raft_consensus.cc:504] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35955 } } peers { permanent_uuid: "e3f762660d1b4794b62d1f7ef1c07edb" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 40691 } } peers { permanent_uuid: "2a8065617fc745b9ac082d470875f81a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40719 } }
I20260808 10:02:00.757313 21932 leader_election.cc:288] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3f762660d1b4794b62d1f7ef1c07edb (127.24.71.193:40691), 2a8065617fc745b9ac082d470875f81a (127.24.71.194:40719)
I20260808 10:02:00.760505 21903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.757528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:40719 (local address 127.24.71.195:40347)
0808 10:02:00.757592 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:00.757606 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:00.757662 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:00.757917 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:00.757918 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:00.757920 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:00.758001 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.758004 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.758697 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.758698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.759590 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.759593 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.760242 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.760243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.760321 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.760326 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 10:02:00.760384 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 10:02:00.760421 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":51}
I20260808 10:02:00.760535 21920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.757614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:40347 (local address 127.24.71.194:40719)
0808 10:02:00.757666 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:00.757668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:00.757717 (+ 49us) server_negotiation.cc:407] Connection header received
0808 10:02:00.757774 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:00.757776 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:00.757788 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:00.757849 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:00.758078 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.758613 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.759676 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.760058 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.760115 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.760122 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:00.760410 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 10:02:00.760460 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 10:02:00.760644 21935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.757536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:40691 (local address 127.24.71.195:60889)
0808 10:02:00.757764 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:00.757776 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:00.757841 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:00.758030 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:00.758030 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:00.758032 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:00.758132 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.758133 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.758765 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.758765 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.759618 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:00.759621 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.760326 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.760327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:00.760427 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.760431 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:02:00.760489 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 10:02:00.760525 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":15,"thread_start_us":104,"threads_started":1}
I20260808 10:02:00.760646 21923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.757614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:60889 (local address 127.24.71.193:40691)
0808 10:02:00.757666 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:00.757668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:00.757845 (+ 177us) server_negotiation.cc:407] Connection header received
0808 10:02:00.757936 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:00.757937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:00.757953 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:00.758019 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:00.758203 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.758674 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.759741 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.760238 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.760313 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.760320 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:00.760516 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 10:02:00.760569 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 10:02:00.760918 21616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a261b58f2f349a2881976c992085cb1" candidate_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a8065617fc745b9ac082d470875f81a" is_pre_election: true
I20260808 10:02:00.761030 21407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a261b58f2f349a2881976c992085cb1" candidate_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f762660d1b4794b62d1f7ef1c07edb" is_pre_election: true
I20260808 10:02:00.761111 21616 raft_consensus.cc:2454] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28821b5303ac4dceb64c9a0abc3ddcc0 in term 0.
I20260808 10:02:00.761204 21407 raft_consensus.cc:2454] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28821b5303ac4dceb64c9a0abc3ddcc0 in term 0.
I20260808 10:02:00.761361 21719 leader_election.cc:302] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28821b5303ac4dceb64c9a0abc3ddcc0, 2a8065617fc745b9ac082d470875f81a; no voters:
I20260808 10:02:00.761509 21932 raft_consensus.cc:2781] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 10:02:00.761581 21932 raft_consensus.cc:482] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 10:02:00.761600 21932 raft_consensus.cc:3037] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:00.762367 21932 raft_consensus.cc:504] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35955 } } peers { permanent_uuid: "e3f762660d1b4794b62d1f7ef1c07edb" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 40691 } } peers { permanent_uuid: "2a8065617fc745b9ac082d470875f81a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40719 } }
I20260808 10:02:00.762526 21932 leader_election.cc:288] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [CANDIDATE]: Term 1 election: Requested vote from peers e3f762660d1b4794b62d1f7ef1c07edb (127.24.71.193:40691), 2a8065617fc745b9ac082d470875f81a (127.24.71.194:40719)
I20260808 10:02:00.762708 21407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a261b58f2f349a2881976c992085cb1" candidate_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f762660d1b4794b62d1f7ef1c07edb"
I20260808 10:02:00.762776 21616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a261b58f2f349a2881976c992085cb1" candidate_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a8065617fc745b9ac082d470875f81a"
I20260808 10:02:00.762775 21407 raft_consensus.cc:3037] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:00.762857 21616 raft_consensus.cc:3037] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:00.763803 21407 raft_consensus.cc:2454] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28821b5303ac4dceb64c9a0abc3ddcc0 in term 1.
I20260808 10:02:00.763815 21616 raft_consensus.cc:2454] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28821b5303ac4dceb64c9a0abc3ddcc0 in term 1.
I20260808 10:02:00.763985 21722 leader_election.cc:302] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28821b5303ac4dceb64c9a0abc3ddcc0, e3f762660d1b4794b62d1f7ef1c07edb; no voters:
I20260808 10:02:00.764114 21932 raft_consensus.cc:2781] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:00.764261 21932 raft_consensus.cc:686] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [term 1 LEADER]: Becoming Leader. State: Replica: 28821b5303ac4dceb64c9a0abc3ddcc0, State: Running, Role: LEADER
I20260808 10:02:00.764379 21932 consensus_queue.cc:237] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35955 } } peers { permanent_uuid: "e3f762660d1b4794b62d1f7ef1c07edb" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 40691 } } peers { permanent_uuid: "2a8065617fc745b9ac082d470875f81a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40719 } }
I20260808 10:02:00.765347 21170 catalog_manager.cc:5495] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28821b5303ac4dceb64c9a0abc3ddcc0 (127.24.71.195). New cstate: current_term: 1 leader_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28821b5303ac4dceb64c9a0abc3ddcc0" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 35955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f762660d1b4794b62d1f7ef1c07edb" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 40691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a8065617fc745b9ac082d470875f81a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40719 } health_report { overall_health: UNKNOWN } } }
W20260808 10:02:00.767627 21690 tablet.cc:2369] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:02:00.774390 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.771942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51146 (local address 127.24.71.195:35955)
0808 10:02:00.772003 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:00.772006 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:00.772036 (+ 30us) server_negotiation.cc:407] Connection header received
0808 10:02:00.772071 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:00.772072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:00.772092 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:00.772176 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:02:00.772334 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.772805 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.773571 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:00.773787 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:00.773864 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:00.774015 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:00.774116 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:00.774225 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:00.774274 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 10:02:00.774283 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 10:02:00.776283 21407 raft_consensus.cc:1261] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb [term 1 FOLLOWER]: Refusing update from remote peer 28821b5303ac4dceb64c9a0abc3ddcc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:02:00.776297 21616 raft_consensus.cc:1261] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a [term 1 FOLLOWER]: Refusing update from remote peer 28821b5303ac4dceb64c9a0abc3ddcc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:02:00.776659 21936 consensus_queue.cc:1035] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f762660d1b4794b62d1f7ef1c07edb" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:02:00.776796 21932 consensus_queue.cc:1035] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a8065617fc745b9ac082d470875f81a" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 40719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:02:00.778960 21939 mvcc.cc:205] Tried to move back new op lower bound from 7316206881897013248 to 7316206881851629568. Current Snapshot: MvccSnapshot[applied={T|T < 7316206881897013248}]
I20260808 10:02:00.779474 21941 mvcc.cc:205] Tried to move back new op lower bound from 7316206881897013248 to 7316206881851629568. Current Snapshot: MvccSnapshot[applied={T|T < 7316206881897013248}]
I20260808 10:02:00.779709 21942 mvcc.cc:205] Tried to move back new op lower bound from 7316206881897013248 to 7316206881851629568. Current Snapshot: MvccSnapshot[applied={T|T < 7316206881897013248}]
I20260808 10:02:00.782541 21172 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:02:00.782624 21172 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:02:00.783433 21172 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 36373e80e17c4dd1906275604112c9bf: Sending DeleteTablet for 3 replicas of tablet 4a261b58f2f349a2881976c992085cb1
I20260808 10:02:00.783768 21799 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a261b58f2f349a2881976c992085cb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:02:00 UTC) from {username='slave'} at 127.0.0.1:51134
I20260808 10:02:00.783818 21585 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a261b58f2f349a2881976c992085cb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:02:00 UTC) from {username='slave'} at 127.0.0.1:36112
I20260808 10:02:00.784058 21954 tablet_replica.cc:330] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0: stopping tablet replica
I20260808 10:02:00.784051 21371 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a261b58f2f349a2881976c992085cb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:02:00 UTC) from {username='slave'} at 127.0.0.1:57868
I20260808 10:02:00.784200 21954 raft_consensus.cc:2229] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 10:02:00.784263 21956 tablet_replica.cc:330] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb: stopping tablet replica
I20260808 10:02:00.784370 21956 raft_consensus.cc:2229] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:02:00.784471 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 21273
I20260808 10:02:00.784497 21956 raft_consensus.cc:2258] T 4a261b58f2f349a2881976c992085cb1 P e3f762660d1b4794b62d1f7ef1c07edb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:02:00.784487 21954 raft_consensus.cc:2258] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:02:00.785337 21954 ts_tablet_manager.cc:1905] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:02:00.786656 21951 tablet_replica.cc:330] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a: stopping tablet replica
I20260808 10:02:00.786819 21951 raft_consensus.cc:2229] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:02:00.786985 21951 raft_consensus.cc:2258] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:02:00.787915 21954 ts_tablet_manager.cc:1918] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:02:00.788048 21954 log.cc:1196] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/4a261b58f2f349a2881976c992085cb1
I20260808 10:02:00.788400 21954 ts_tablet_manager.cc:1939] T 4a261b58f2f349a2881976c992085cb1 P 28821b5303ac4dceb64c9a0abc3ddcc0: Deleting consensus metadata
I20260808 10:02:00.788893 21150 catalog_manager.cc:4841] TS 28821b5303ac4dceb64c9a0abc3ddcc0 (127.24.71.195:35955): tablet 4a261b58f2f349a2881976c992085cb1 (table test-table [id=0844e48c84f64cd1b51d9f50d587d2b4]) successfully deleted
I20260808 10:02:00.801749 21951 ts_tablet_manager.cc:1905] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:02:00.803313 21951 ts_tablet_manager.cc:1918] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:02:00.803462 21951 log.cc:1196] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/4a261b58f2f349a2881976c992085cb1
I20260808 10:02:00.803723 21951 ts_tablet_manager.cc:1939] T 4a261b58f2f349a2881976c992085cb1 P 2a8065617fc745b9ac082d470875f81a: Deleting consensus metadata
I20260808 10:02:00.804207 21146 catalog_manager.cc:4841] TS 2a8065617fc745b9ac082d470875f81a (127.24.71.194:40719): tablet 4a261b58f2f349a2881976c992085cb1 (table test-table [id=0844e48c84f64cd1b51d9f50d587d2b4]) successfully deleted
W20260808 10:02:00.806484 21149 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:40691 (error 108)
I20260808 10:02:00.806681 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 21484
I20260808 10:02:00.810842 21916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:00.810686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:40691 (local address 127.0.0.1:57872)
0808 10:02:00.810745 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:00.810796 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:40691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 10:02:00.810969 21149 catalog_manager.cc:4584] TS e3f762660d1b4794b62d1f7ef1c07edb (127.24.71.193:40691): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4a261b58f2f349a2881976c992085cb1: Network error: Client connection negotiation failed: client connection to 127.24.71.193:40691: connect: Connection refused (error 111)
I20260808 10:02:00.821332 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 21695
I20260808 10:02:00.830948 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 21126
2026-08-08T10:02:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (767 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:00 dist-test-slave-gw5c krb5kdc[21963](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:00 dist-test-slave-gw5c krb5kdc[21963](info): set up 2 sockets
Aug 08 10:02:00 dist-test-slave-gw5c krb5kdc[21963](info): commencing operation
krb5kdc: starting...
W20260808 10:02:02.073781 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:02 dist-test-slave-gw5c krb5kdc[21963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:02:02.202338 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:43287
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:43287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:02.288012 21988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:02.288246 21988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:02.288275 21988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:02.289440 21988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:02.289479 21988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:02.289494 21988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:02.289507 21988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:02.289520 21988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:02.291011 21988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:43287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:43287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:02.291229 21988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:02.291464 21988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:02.296617 21997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:02.296685 21988 server_base.cc:1034] running on GCE node
W20260808 10:02:02.296623 21999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:02.296623 22002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:02.297078 21988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:02.297412 21988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:02.298589 21988 hybrid_clock.cc:648] HybridClock initialized: now 1786183322298573 us; error 34 us; skew 500 ppm
Aug 08 10:02:02 dist-test-slave-gw5c krb5kdc[21963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183322, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:02.301256 21988 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:02:02.301776 21988 webserver.cc:460] Webserver started at http://127.24.71.254:44883/ using document root <none> and password file <none>
I20260808 10:02:02.302028 21988 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:02.302099 21988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:02.302258 21988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:02.303439 21988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "0c5af8dd504e4cf19f7570b7de7b1f99"
format_stamp: "Formatted at 2026-08-08 10:02:02 on dist-test-slave-gw5c"
server_key: "a8b90fc1e113e11993440d2dbd697658"
server_key_iv: "b71465bb74c2708ecd58774a0518c9c9"
server_key_version: "encryptionkey@0"
I20260808 10:02:02.303846 21988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "0c5af8dd504e4cf19f7570b7de7b1f99"
format_stamp: "Formatted at 2026-08-08 10:02:02 on dist-test-slave-gw5c"
server_key: "a8b90fc1e113e11993440d2dbd697658"
server_key_iv: "b71465bb74c2708ecd58774a0518c9c9"
server_key_version: "encryptionkey@0"
I20260808 10:02:02.305286 21988 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 10:02:02.306103 22018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:02.306283 21988 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:02:02.306417 21988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "0c5af8dd504e4cf19f7570b7de7b1f99"
format_stamp: "Formatted at 2026-08-08 10:02:02 on dist-test-slave-gw5c"
server_key: "a8b90fc1e113e11993440d2dbd697658"
server_key_iv: "b71465bb74c2708ecd58774a0518c9c9"
server_key_version: "encryptionkey@0"
I20260808 10:02:02.306500 21988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:02.316893 21988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:02.319116 21988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:02.319307 21988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:02.323660 21988 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:43287
I20260808 10:02:02.323699 22095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:43287 every 8 connection(s)
I20260808 10:02:02.324054 21988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:02.324934 22097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:02.327194 22097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99: Bootstrap starting.
I20260808 10:02:02.327869 22097 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:02.328114 22097 log.cc:824] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:02.328536 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 21988
I20260808 10:02:02.328678 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:02.328936 24863 external_mini_cluster.cc:1428] Setting key 829325ebcb39cb33b96e270797435c72
I20260808 10:02:02.328999 22097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99: No bootstrap required, opened a new log
I20260808 10:02:02.331364 22097 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5af8dd504e4cf19f7570b7de7b1f99" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43287 } }
I20260808 10:02:02.331585 22097 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:02.331629 22097 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5af8dd504e4cf19f7570b7de7b1f99, State: Initialized, Role: FOLLOWER
I20260808 10:02:02.331786 22097 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5af8dd504e4cf19f7570b7de7b1f99" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43287 } }
I20260808 10:02:02.331880 22097 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:02.331933 22097 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:02.331980 22097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:02.332727 22097 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5af8dd504e4cf19f7570b7de7b1f99" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43287 } }
I20260808 10:02:02.332844 22097 leader_election.cc:302] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c5af8dd504e4cf19f7570b7de7b1f99; no voters:
I20260808 10:02:02.333006 22097 leader_election.cc:288] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:02.333061 22104 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:02.333232 22104 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [term 1 LEADER]: Becoming Leader. State: Replica: 0c5af8dd504e4cf19f7570b7de7b1f99, State: Running, Role: LEADER
I20260808 10:02:02.333288 22097 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:02.333323 22104 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5af8dd504e4cf19f7570b7de7b1f99" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43287 } }
I20260808 10:02:02.333649 22104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c5af8dd504e4cf19f7570b7de7b1f99. Latest consensus state: current_term: 1 leader_uuid: "0c5af8dd504e4cf19f7570b7de7b1f99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5af8dd504e4cf19f7570b7de7b1f99" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43287 } } }
I20260808 10:02:02.333745 22104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:02.333659 22105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c5af8dd504e4cf19f7570b7de7b1f99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5af8dd504e4cf19f7570b7de7b1f99" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 43287 } } }
I20260808 10:02:02.333837 22105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:02.334638 22116 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:02.335355 22116 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:02.337172 22116 catalog_manager.cc:1347] Generated new cluster ID: 1a54da4a77e7413f837bb12c598e62be
I20260808 10:02:02.337232 22116 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 10:02:02 dist-test-slave-gw5c krb5kdc[21963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:02:02.341360 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.329495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37242 (local address 127.24.71.254:43287)
0808 10:02:02.329714 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:02.329724 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:02.329764 (+ 40us) server_negotiation.cc:407] Connection header received
0808 10:02:02.330524 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:02.330534 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:02.330600 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:02.330758 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:02.331362 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.333102 (+ 1740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.334332 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.335006 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.335092 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.338020 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:02.338025 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:02.338025 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:02.338038 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:02.339755 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:02.340143 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:02.340146 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:02.340146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:02.340235 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:02.340494 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:02.340495 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:02.340496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:02.340742 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:02.340922 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:02.340995 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 10:02:02.341142 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":92,"threads_started":1}
I20260808 10:02:02.353014 22116 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:02.353871 22116 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:02.360262 22116 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99: Generated new TSK 0
I20260808 10:02:02.360472 22116 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.71.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
Entry for principal kudu/127.24.71.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab.
I20260808 10:02:02.398831 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43287
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:02.499948 22138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:02.500162 22138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:02.500190 22138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:02.501376 22138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:02.501425 22138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:02.501477 22138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:02:02.502965 22138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.193.keytab
--principal=kudu/127.24.71.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:02.503240 22138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:02.503520 22138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:02.508806 22149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:02.508862 22138 server_base.cc:1034] running on GCE node
W20260808 10:02:02.508834 22143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:02.508829 22146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:02.509218 22138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:02.509510 22138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:02.510680 22138 hybrid_clock.cc:648] HybridClock initialized: now 1786183322510667 us; error 29 us; skew 500 ppm
Aug 08 10:02:02 dist-test-slave-gw5c krb5kdc[21963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183322, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:02.513244 22138 init.cc:377] Logged in from keytab as kudu/127.24.71.193@KRBTEST.COM (short username kudu)
I20260808 10:02:02.513698 22138 webserver.cc:460] Webserver started at http://127.24.71.193:41655/ using document root <none> and password file <none>
I20260808 10:02:02.513931 22138 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:02.514002 22138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:02.514159 22138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:02.515244 22138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "e0c3be4cb71347219055b6cd5d09733a"
format_stamp: "Formatted at 2026-08-08 10:02:02 on dist-test-slave-gw5c"
server_key: "7002deba326e866d331e827dc550c4e1"
server_key_iv: "04d670ac3bfa90b7388724f4d23343cc"
server_key_version: "encryptionkey@0"
I20260808 10:02:02.515659 22138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "e0c3be4cb71347219055b6cd5d09733a"
format_stamp: "Formatted at 2026-08-08 10:02:02 on dist-test-slave-gw5c"
server_key: "7002deba326e866d331e827dc550c4e1"
server_key_iv: "04d670ac3bfa90b7388724f4d23343cc"
server_key_version: "encryptionkey@0"
I20260808 10:02:02.517055 22138 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:02:02.517848 22160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:02.518070 22138 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:02:02.518203 22138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "e0c3be4cb71347219055b6cd5d09733a"
format_stamp: "Formatted at 2026-08-08 10:02:02 on dist-test-slave-gw5c"
server_key: "7002deba326e866d331e827dc550c4e1"
server_key_iv: "04d670ac3bfa90b7388724f4d23343cc"
server_key_version: "encryptionkey@0"
I20260808 10:02:02.518301 22138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:02.528882 22138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:02.530928 22138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:02.531126 22138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:02.531445 22138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:02:02.531859 22138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:02:02.531919 22138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:02.531968 22138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:02:02.531998 22138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:02.538787 22138 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:42289
I20260808 10:02:02.538834 22338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:42289 every 8 connection(s)
I20260808 10:02:02.539180 22138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
Aug 08 10:02:02 dist-test-slave-gw5c krb5kdc[21963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183322, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.193@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:02:02.546257 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 22138
I20260808 10:02:02.546396 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 10:02:02.546700 24863 external_mini_cluster.cc:1428] Setting key 5a28f4901844ac471934a857ef7aeecb
I20260808 10:02:02.549412 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.539987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:39999 (local address 127.24.71.254:43287)
0808 10:02:02.540048 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:02.540050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:02.540252 (+ 202us) server_negotiation.cc:407] Connection header received
0808 10:02:02.540748 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:02.540749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:02.540760 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:02.540822 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:02.541763 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.542297 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.543287 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.543554 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.543610 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.546109 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:02.546112 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:02.546112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:02.546121 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:02.547958 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:02.548372 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:02.548374 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:02.548374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:02.548438 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:02.548680 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:02.548681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:02.548682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:02.548829 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:02.548901 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:02.549155 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 10:02:02.549267 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 10:02:02.549429 22342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.539929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43287 (local address 127.24.71.193:39999)
0808 10:02:02.540110 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:02.540161 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:02.540665 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:02.540878 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:02.540881 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:02.541487 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:02.541684 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.541688 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.542389 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.542390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.543209 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.543211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.543631 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.543632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.543744 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.544371 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:02.544381 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:02.545925 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:02.548047 (+ 2122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:02.548055 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:02.548057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:02.548297 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:02.548509 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:02.548510 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:02.548510 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:02.548615 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:02.548895 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:02.548900 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:02.549026 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 10:02:02.549111 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 10:02:02.549241 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":95,"threads_started":1}
I20260808 10:02:02.550179 22339 heartbeater.cc:347] Connected to a master server at 127.24.71.254:43287
I20260808 10:02:02.550310 22339 heartbeater.cc:464] Registering TS with master...
I20260808 10:02:02.550527 22339 heartbeater.cc:511] Master 127.24.71.254:43287 requested a full tablet report, sending...
I20260808 10:02:02.551064 22045 ts_manager.cc:194] Registered new tserver with Master: e0c3be4cb71347219055b6cd5d09733a (127.24.71.193:42289)
I20260808 10:02:02.551816 22045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.193@KRBTEST.COM'} at 127.24.71.193:39999
WARNING: no policy specified for kudu/127.24.71.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
Entry for principal kudu/127.24.71.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab.
I20260808 10:02:02.576092 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43287
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:02.661358 22345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:02.661680 22345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:02.661713 22345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:02.662918 22345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:02.662963 22345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:02.662992 22345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:02:02.664577 22345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.194.keytab
--principal=kudu/127.24.71.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:02.664847 22345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:02.665093 22345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:02.670939 22357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:02.670955 22356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:02.670936 22360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:02.671109 22345 server_base.cc:1034] running on GCE node
I20260808 10:02:02.671382 22345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:02.671670 22345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:02.672839 22345 hybrid_clock.cc:648] HybridClock initialized: now 1786183322672818 us; error 42 us; skew 500 ppm
Aug 08 10:02:02 dist-test-slave-gw5c krb5kdc[21963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183322, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:02.675516 22345 init.cc:377] Logged in from keytab as kudu/127.24.71.194@KRBTEST.COM (short username kudu)
I20260808 10:02:02.675985 22345 webserver.cc:460] Webserver started at http://127.24.71.194:37561/ using document root <none> and password file <none>
I20260808 10:02:02.676219 22345 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:02.676286 22345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:02.676448 22345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:02.677552 22345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "69daffabd4394319b905e00a79fed3e4"
format_stamp: "Formatted at 2026-08-08 10:02:02 on dist-test-slave-gw5c"
server_key: "d8a3f2fe207efe7d95c10b885357402c"
server_key_iv: "7e1b4fa7c5b6111a280174101862a83e"
server_key_version: "encryptionkey@0"
I20260808 10:02:02.677940 22345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "69daffabd4394319b905e00a79fed3e4"
format_stamp: "Formatted at 2026-08-08 10:02:02 on dist-test-slave-gw5c"
server_key: "d8a3f2fe207efe7d95c10b885357402c"
server_key_iv: "7e1b4fa7c5b6111a280174101862a83e"
server_key_version: "encryptionkey@0"
I20260808 10:02:02.679313 22345 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:02:02.680109 22371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:02.680302 22345 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:02.680409 22345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "69daffabd4394319b905e00a79fed3e4"
format_stamp: "Formatted at 2026-08-08 10:02:02 on dist-test-slave-gw5c"
server_key: "d8a3f2fe207efe7d95c10b885357402c"
server_key_iv: "7e1b4fa7c5b6111a280174101862a83e"
server_key_version: "encryptionkey@0"
I20260808 10:02:02.680485 22345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:02.697749 22345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:02.700415 22345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:02.700601 22345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:02.700870 22345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:02:02.701203 22345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:02:02.701257 22345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:02.701308 22345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:02:02.701352 22345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:02.707702 22345 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:43977
I20260808 10:02:02.707762 22550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:43977 every 8 connection(s)
I20260808 10:02:02.708180 22345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 10:02:02.712478 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 22345
I20260808 10:02:02.712607 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 10:02:02.712815 24863 external_mini_cluster.cc:1428] Setting key f289d8d40a54d457bfeb21a2797d6a06
Aug 08 10:02:02 dist-test-slave-gw5c krb5kdc[21963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183322, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.194@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:02:02.718676 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.708977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:58337 (local address 127.24.71.254:43287)
0808 10:02:02.709042 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:02.709044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:02.709342 (+ 298us) server_negotiation.cc:407] Connection header received
0808 10:02:02.709813 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:02.709815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:02.709830 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:02.709905 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:02.710982 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.711545 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.712749 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.712981 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.713079 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.715751 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:02.715753 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:02.715761 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:02.715769 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:02.717192 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:02.717618 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:02.717619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:02.717620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:02.717683 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:02.717971 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:02.717972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:02.717973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:02.718124 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:02.718195 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:02.718498 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 10:02:02.718582 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 10:02:02.718889 22555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.708966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43287 (local address 127.24.71.194:58337)
0808 10:02:02.709142 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:02.709181 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:02.709671 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:02.709979 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:02.709983 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:02.710656 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:02.710867 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.710872 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.711633 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.711634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.712636 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.712639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.713087 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.713089 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.713274 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.713949 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:02.713960 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:02.715640 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:02.717288 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:02.717297 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:02.717299 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:02.717538 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:02.717756 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:02.717757 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:02.717757 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:02.717890 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:02.718197 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:02.718205 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:02.718356 (+ 151us) client_negotiation.cc:769] Sending connection context
0808 10:02:02.718462 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 10:02:02.718634 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":89,"threads_started":1}
I20260808 10:02:02.719439 22551 heartbeater.cc:347] Connected to a master server at 127.24.71.254:43287
I20260808 10:02:02.719538 22551 heartbeater.cc:464] Registering TS with master...
I20260808 10:02:02.719744 22551 heartbeater.cc:511] Master 127.24.71.254:43287 requested a full tablet report, sending...
I20260808 10:02:02.720167 22045 ts_manager.cc:194] Registered new tserver with Master: 69daffabd4394319b905e00a79fed3e4 (127.24.71.194:43977)
I20260808 10:02:02.720736 22045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.194@KRBTEST.COM'} at 127.24.71.194:58337
WARNING: no policy specified for kudu/127.24.71.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
Entry for principal kudu/127.24.71.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab.
I20260808 10:02:02.743904 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43287
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:02.835729 22558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:02.835951 22558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:02.835979 22558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:02.837175 22558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:02.837224 22558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:02.837251 22558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:02:02.838814 22558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.195.keytab
--principal=kudu/127.24.71.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:43287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:02.839098 22558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:02.839366 22558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:02.844736 22566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:02.844918 22558 server_base.cc:1034] running on GCE node
W20260808 10:02:02.844657 22569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:02.844657 22565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:02.845244 22558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:02.845515 22558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:02.846697 22558 hybrid_clock.cc:648] HybridClock initialized: now 1786183322846684 us; error 43 us; skew 500 ppm
Aug 08 10:02:02 dist-test-slave-gw5c krb5kdc[21963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183322, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:02.849613 22558 init.cc:377] Logged in from keytab as kudu/127.24.71.195@KRBTEST.COM (short username kudu)
I20260808 10:02:02.850087 22558 webserver.cc:460] Webserver started at http://127.24.71.195:44793/ using document root <none> and password file <none>
I20260808 10:02:02.850324 22558 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:02.850373 22558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:02.850553 22558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:02.851722 22558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "a93074069de540c88268f82659df6c06"
format_stamp: "Formatted at 2026-08-08 10:02:02 on dist-test-slave-gw5c"
server_key: "7147acc6164a29a2104b08be2cf08843"
server_key_iv: "69d89e3431ae21d53c649e12e753eaaa"
server_key_version: "encryptionkey@0"
I20260808 10:02:02.852094 22558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "a93074069de540c88268f82659df6c06"
format_stamp: "Formatted at 2026-08-08 10:02:02 on dist-test-slave-gw5c"
server_key: "7147acc6164a29a2104b08be2cf08843"
server_key_iv: "69d89e3431ae21d53c649e12e753eaaa"
server_key_version: "encryptionkey@0"
I20260808 10:02:02.853504 22558 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:02:02.854295 22578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:02.854480 22558 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:02.854573 22558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "a93074069de540c88268f82659df6c06"
format_stamp: "Formatted at 2026-08-08 10:02:02 on dist-test-slave-gw5c"
server_key: "7147acc6164a29a2104b08be2cf08843"
server_key_iv: "69d89e3431ae21d53c649e12e753eaaa"
server_key_version: "encryptionkey@0"
I20260808 10:02:02.854640 22558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:02.861913 22558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:02.864104 22558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:02.864230 22558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:02.864449 22558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:02:02.864792 22558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:02:02.864828 22558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:02.864852 22558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:02:02.864897 22558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:02.871062 22558 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:39311
I20260808 10:02:02.871160 22763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:39311 every 8 connection(s)
I20260808 10:02:02.871569 22558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
Aug 08 10:02:02 dist-test-slave-gw5c krb5kdc[21963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183322, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.195@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:02:02.880306 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 22558
I20260808 10:02:02.880419 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 10:02:02.880620 24863 external_mini_cluster.cc:1428] Setting key 5b6d86ec3c6003883a61229406daa269
I20260808 10:02:02.881906 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.872414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:57555 (local address 127.24.71.254:43287)
0808 10:02:02.872476 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:02.872479 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:02.872667 (+ 188us) server_negotiation.cc:407] Connection header received
0808 10:02:02.873237 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:02.873239 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:02.873253 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:02.873314 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:02.874332 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.874867 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.876010 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.876224 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.876314 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.878638 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:02.878639 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:02.878640 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:02.878647 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:02.880208 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:02.880734 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:02.880736 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:02.880736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:02.880806 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:02.881173 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:02.881174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:02.881174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:02.881334 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:02.881416 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:02.881749 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 10:02:02.881840 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 10:02:02.882099 22766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.872352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:43287 (local address 127.24.71.195:57555)
0808 10:02:02.872529 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:02.872579 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:02.873123 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:02.873398 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:02.873402 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:02.874017 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:02.874221 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.874227 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.874984 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.874985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.875915 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.875918 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.876329 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.876330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.876469 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.877046 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:02.877056 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:02.878526 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:02.880298 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:02.880306 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:02.880308 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:02.880656 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:02.880893 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:02.880894 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:02.880895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:02.881090 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:02.881411 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:02.881419 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:02.881595 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 10:02:02.881717 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 10:02:02.881874 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":94,"threads_started":1}
I20260808 10:02:02.882557 22764 heartbeater.cc:347] Connected to a master server at 127.24.71.254:43287
I20260808 10:02:02.882658 22764 heartbeater.cc:464] Registering TS with master...
I20260808 10:02:02.882809 22764 heartbeater.cc:511] Master 127.24.71.254:43287 requested a full tablet report, sending...
I20260808 10:02:02.883188 22045 ts_manager.cc:194] Registered new tserver with Master: a93074069de540c88268f82659df6c06 (127.24.71.195:39311)
I20260808 10:02:02.883674 22045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.71.195@KRBTEST.COM'} at 127.24.71.195:57555
I20260808 10:02:02.892582 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 10:02:02.900332 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.894014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37256 (local address 127.24.71.254:43287)
0808 10:02:02.894078 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:02.894080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:02.894215 (+ 135us) server_negotiation.cc:407] Connection header received
0808 10:02:02.894255 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:02.894255 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:02.894265 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:02.894324 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:02.894949 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.895511 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.896259 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.896454 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.896516 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.897845 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:02.897846 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:02.897847 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:02.897857 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:02.899188 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:02.899598 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:02.899599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:02.899600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:02.899655 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:02.899830 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:02.899830 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:02.899830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:02.899976 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:02.900052 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:02.900193 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 10:02:02.900262 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 10:02:02.902087 22045 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 10:02:02.903745 22045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 10:02:02.910658 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.906209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:43977 (local address 127.0.0.1:53594)
0808 10:02:02.906586 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:02.906632 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:02.906704 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:02.906999 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:02.907003 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:02.907006 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:02.907092 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.907095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.908256 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.908257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.909399 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.909402 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.910347 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.910348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.910430 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.910445 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 10:02:02.910522 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 10:02:02.910571 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":96,"threads_started":1}
I20260808 10:02:02.910691 22785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.906332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53594 (local address 127.24.71.194:43977)
0808 10:02:02.906797 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:02.906811 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:02.906822 (+ 11us) server_negotiation.cc:407] Connection header received
0808 10:02:02.906870 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:02.906872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:02.906887 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:02.907053 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:02.907145 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.908160 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.909485 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.910264 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.910345 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.910419 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:02.910553 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 10:02:02.910598 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":134,"threads_started":1}
I20260808 10:02:02.910899 22784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.906319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60312 (local address 127.24.71.193:42289)
0808 10:02:02.906587 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:02.906593 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:02.906695 (+ 102us) server_negotiation.cc:407] Connection header received
0808 10:02:02.906967 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:02.906971 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:02.906990 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:02.907067 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:02.907260 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.908375 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.909693 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.910398 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.910463 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.910543 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:02.910751 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 10:02:02.910803 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":135,"threads_started":1}
I20260808 10:02:02.911098 22786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.906210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:42289 (local address 127.0.0.1:60312)
0808 10:02:02.906634 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:02.906643 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:02.906720 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:02.907150 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:02.907151 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:02.907154 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:02.907191 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.907192 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.908498 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.908499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.909605 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.909607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.910582 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.910583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.910646 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.910650 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:02:02.910984 (+ 334us) client_negotiation.cc:240] Negotiation successful
0808 10:02:02.911032 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":69,"threads_started":1}
I20260808 10:02:02.911506 22452 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd04c16c28f412e81468de3fb4e346e (DEFAULT_TABLE table=test-table [id=a832888d998e4bc7834e1fc1952cece8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:02:02.911871 22452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd04c16c28f412e81468de3fb4e346e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:02.911814 22242 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd04c16c28f412e81468de3fb4e346e (DEFAULT_TABLE table=test-table [id=a832888d998e4bc7834e1fc1952cece8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:02:02.912142 22242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd04c16c28f412e81468de3fb4e346e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:02.914592 22788 tablet_bootstrap.cc:492] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4: Bootstrap starting.
I20260808 10:02:02.914652 22792 tablet_bootstrap.cc:492] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a: Bootstrap starting.
I20260808 10:02:02.915378 22788 tablet_bootstrap.cc:654] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:02.915510 22783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.906450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:39311 (local address 127.0.0.1:36196)
0808 10:02:02.907504 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:02.907515 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:02.907579 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:02.907765 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:02.907766 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:02.907768 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:02.907813 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.907814 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.909077 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.909078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.910040 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.910042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.915179 (+ 5137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.915181 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.915254 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.915260 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 10:02:02.915324 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 10:02:02.915376 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1031,"thread_start_us":71,"threads_started":1}
I20260808 10:02:02.915560 22787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.906566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36196 (local address 127.24.71.195:39311)
0808 10:02:02.906742 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:02.906747 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:02.907601 (+ 854us) server_negotiation.cc:407] Connection header received
0808 10:02:02.907654 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:02.907657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:02.907673 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:02.907755 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:02.907874 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.908961 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.910148 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.914978 (+ 4830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.915063 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.915137 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:02.915373 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 10:02:02.915465 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":108,"threads_started":1}
I20260808 10:02:02.915928 22792 tablet_bootstrap.cc:654] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:02.916065 22788 log.cc:824] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:02.916246 22659 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd04c16c28f412e81468de3fb4e346e (DEFAULT_TABLE table=test-table [id=a832888d998e4bc7834e1fc1952cece8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:02:02.916554 22659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd04c16c28f412e81468de3fb4e346e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:02.916571 22792 log.cc:824] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:02.917119 22788 tablet_bootstrap.cc:492] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4: No bootstrap required, opened a new log
I20260808 10:02:02.917201 22788 ts_tablet_manager.cc:1397] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 10:02:02.917312 22792 tablet_bootstrap.cc:492] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a: No bootstrap required, opened a new log
I20260808 10:02:02.917403 22792 ts_tablet_manager.cc:1397] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 10:02:02.918774 22792 raft_consensus.cc:348] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69daffabd4394319b905e00a79fed3e4" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43977 } } peers { permanent_uuid: "e0c3be4cb71347219055b6cd5d09733a" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42289 } } peers { permanent_uuid: "a93074069de540c88268f82659df6c06" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 39311 } }
I20260808 10:02:02.918957 22792 raft_consensus.cc:374] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:02.919023 22792 raft_consensus.cc:729] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0c3be4cb71347219055b6cd5d09733a, State: Initialized, Role: FOLLOWER
I20260808 10:02:02.919159 22792 consensus_queue.cc:260] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69daffabd4394319b905e00a79fed3e4" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43977 } } peers { permanent_uuid: "e0c3be4cb71347219055b6cd5d09733a" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42289 } } peers { permanent_uuid: "a93074069de540c88268f82659df6c06" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 39311 } }
I20260808 10:02:02.919488 22792 ts_tablet_manager.cc:1428] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 10:02:02.919317 22788 raft_consensus.cc:348] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69daffabd4394319b905e00a79fed3e4" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43977 } } peers { permanent_uuid: "e0c3be4cb71347219055b6cd5d09733a" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42289 } } peers { permanent_uuid: "a93074069de540c88268f82659df6c06" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 39311 } }
I20260808 10:02:02.919540 22788 raft_consensus.cc:374] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:02.919602 22788 raft_consensus.cc:729] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69daffabd4394319b905e00a79fed3e4, State: Initialized, Role: FOLLOWER
I20260808 10:02:02.919659 22339 heartbeater.cc:503] Master 127.24.71.254:43287 was elected leader, sending a full tablet report...
I20260808 10:02:02.919746 22788 consensus_queue.cc:260] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69daffabd4394319b905e00a79fed3e4" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43977 } } peers { permanent_uuid: "e0c3be4cb71347219055b6cd5d09733a" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42289 } } peers { permanent_uuid: "a93074069de540c88268f82659df6c06" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 39311 } }
I20260808 10:02:02.920033 22788 ts_tablet_manager.cc:1428] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 10:02:02.920076 22551 heartbeater.cc:503] Master 127.24.71.254:43287 was elected leader, sending a full tablet report...
I20260808 10:02:02.920632 22798 tablet_bootstrap.cc:492] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06: Bootstrap starting.
I20260808 10:02:02.921377 22798 tablet_bootstrap.cc:654] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:02.921871 22798 log.cc:824] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:02.922585 22798 tablet_bootstrap.cc:492] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06: No bootstrap required, opened a new log
I20260808 10:02:02.922643 22798 ts_tablet_manager.cc:1397] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 10:02:02.924305 22798 raft_consensus.cc:348] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69daffabd4394319b905e00a79fed3e4" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43977 } } peers { permanent_uuid: "e0c3be4cb71347219055b6cd5d09733a" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42289 } } peers { permanent_uuid: "a93074069de540c88268f82659df6c06" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 39311 } }
I20260808 10:02:02.924440 22798 raft_consensus.cc:374] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:02.924463 22798 raft_consensus.cc:729] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a93074069de540c88268f82659df6c06, State: Initialized, Role: FOLLOWER
I20260808 10:02:02.924628 22798 consensus_queue.cc:260] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69daffabd4394319b905e00a79fed3e4" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43977 } } peers { permanent_uuid: "e0c3be4cb71347219055b6cd5d09733a" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42289 } } peers { permanent_uuid: "a93074069de540c88268f82659df6c06" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 39311 } }
I20260808 10:02:02.924880 22798 ts_tablet_manager.cc:1428] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 10:02:02.924943 22764 heartbeater.cc:503] Master 127.24.71.254:43287 was elected leader, sending a full tablet report...
I20260808 10:02:02.937335 22800 raft_consensus.cc:482] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:02:02.937475 22800 raft_consensus.cc:504] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69daffabd4394319b905e00a79fed3e4" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43977 } } peers { permanent_uuid: "e0c3be4cb71347219055b6cd5d09733a" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42289 } } peers { permanent_uuid: "a93074069de540c88268f82659df6c06" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 39311 } }
I20260808 10:02:02.937892 22800 leader_election.cc:288] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0c3be4cb71347219055b6cd5d09733a (127.24.71.193:42289), a93074069de540c88268f82659df6c06 (127.24.71.195:39311)
I20260808 10:02:02.940191 22803 raft_consensus.cc:482] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:02:02.940323 22803 raft_consensus.cc:504] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69daffabd4394319b905e00a79fed3e4" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43977 } } peers { permanent_uuid: "e0c3be4cb71347219055b6cd5d09733a" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42289 } } peers { permanent_uuid: "a93074069de540c88268f82659df6c06" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 39311 } }
I20260808 10:02:02.940687 22803 leader_election.cc:288] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69daffabd4394319b905e00a79fed3e4 (127.24.71.194:43977), e0c3be4cb71347219055b6cd5d09733a (127.24.71.193:42289)
I20260808 10:02:02.941256 22555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.938073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:42289 (local address 127.24.71.194:38777)
0808 10:02:02.938141 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:02.938154 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:02.938201 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:02.938391 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:02.938393 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:02.938395 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:02.938493 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.938495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.939167 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.939168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.940204 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.940208 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.940961 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.940962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.941051 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.941055 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:02:02.941108 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 10:02:02.941161 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 10:02:02.941475 22784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.938168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:38777 (local address 127.24.71.193:42289)
0808 10:02:02.938227 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:02.938230 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:02.938244 (+ 14us) server_negotiation.cc:407] Connection header received
0808 10:02:02.938278 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:02.938279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:02.938291 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:02.938382 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:02.938571 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.939077 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.940280 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.940827 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.940900 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.940923 (+ 23us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:02.941358 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 10:02:02.941410 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 10:02:02.942266 22270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd04c16c28f412e81468de3fb4e346e" candidate_uuid: "69daffabd4394319b905e00a79fed3e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0c3be4cb71347219055b6cd5d09733a" is_pre_election: true
I20260808 10:02:02.942435 22270 raft_consensus.cc:2454] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69daffabd4394319b905e00a79fed3e4 in term 0.
I20260808 10:02:02.942674 22373 leader_election.cc:302] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69daffabd4394319b905e00a79fed3e4, e0c3be4cb71347219055b6cd5d09733a; no voters:
I20260808 10:02:02.942824 22804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.938219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:39311 (local address 127.24.71.194:41981)
0808 10:02:02.938444 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:02.938452 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:02.938528 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:02.938670 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:02.938671 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:02.938672 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:02.938753 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.938755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.939491 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.939492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.941339 (+ 1847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.941340 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.942571 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.942572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.942647 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.942654 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 10:02:02.942708 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 10:02:02.942750 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":140,"threads_started":1}
I20260808 10:02:02.943090 22787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.938333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:41981 (local address 127.24.71.195:39311)
0808 10:02:02.938384 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:02.938386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:02.938517 (+ 131us) server_negotiation.cc:407] Connection header received
0808 10:02:02.938584 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:02.938585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:02.938594 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:02.938666 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:02.938822 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.939361 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.941451 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.942023 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.942094 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.942123 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:02.942981 (+ 858us) server_negotiation.cc:299] Negotiation successful
0808 10:02:02.943026 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":28}
I20260808 10:02:02.943379 22685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd04c16c28f412e81468de3fb4e346e" candidate_uuid: "69daffabd4394319b905e00a79fed3e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a93074069de540c88268f82659df6c06" is_pre_election: true
I20260808 10:02:02.943475 22800 raft_consensus.cc:2781] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 10:02:02.943538 22800 raft_consensus.cc:482] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 10:02:02.943542 22685 raft_consensus.cc:2454] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69daffabd4394319b905e00a79fed3e4 in term 0.
I20260808 10:02:02.943567 22800 raft_consensus.cc:3037] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:02.944082 22766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.940792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:43977 (local address 127.24.71.195:41099)
0808 10:02:02.940873 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:02.940883 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:02.940928 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:02.941137 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:02.941138 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:02.941139 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:02.941197 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.941198 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.941972 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.941973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.943124 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.943127 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.943833 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.943834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.943911 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.943915 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:02:02.943977 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 10:02:02.944017 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 10:02:02.944096 22785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.940992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:41099 (local address 127.24.71.194:43977)
0808 10:02:02.941031 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:02.941033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:02.941040 (+ 7us) server_negotiation.cc:407] Connection header received
0808 10:02:02.941061 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:02.941062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:02.941069 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:02.941117 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:02.941262 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.941885 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.943222 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.943768 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.943834 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.943841 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:02.943999 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 10:02:02.944037 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 10:02:02.944373 22478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd04c16c28f412e81468de3fb4e346e" candidate_uuid: "a93074069de540c88268f82659df6c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69daffabd4394319b905e00a79fed3e4" is_pre_election: true
I20260808 10:02:02.944625 22800 raft_consensus.cc:504] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69daffabd4394319b905e00a79fed3e4" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43977 } } peers { permanent_uuid: "e0c3be4cb71347219055b6cd5d09733a" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42289 } } peers { permanent_uuid: "a93074069de540c88268f82659df6c06" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 39311 } }
I20260808 10:02:02.944739 22478 raft_consensus.cc:2379] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a93074069de540c88268f82659df6c06 in current term 1: Already voted for candidate 69daffabd4394319b905e00a79fed3e4 in this term.
I20260808 10:02:02.944826 22807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.941067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:59911 (local address 127.24.71.193:42289)
0808 10:02:02.941504 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:02.941506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:02.941513 (+ 7us) server_negotiation.cc:407] Connection header received
0808 10:02:02.941533 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:02.941533 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:02.941542 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:02.941598 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:02.941778 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.942440 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.943840 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.944454 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.944544 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.944552 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:02.944711 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 10:02:02.944746 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":82,"threads_started":1}
I20260808 10:02:02.944825 22805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.940869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:42289 (local address 127.24.71.195:59911)
0808 10:02:02.941208 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:02.941218 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:02.941263 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:02.941638 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:02.941639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:02.941641 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:02.941703 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.941704 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.942549 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.942550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.943739 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:02.943742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.944554 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.944555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:02.944628 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.944631 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 10:02:02.944704 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 10:02:02.944743 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":103,"threads_started":1}
I20260808 10:02:02.944914 22270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd04c16c28f412e81468de3fb4e346e" candidate_uuid: "69daffabd4394319b905e00a79fed3e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0c3be4cb71347219055b6cd5d09733a"
I20260808 10:02:02.945016 22270 raft_consensus.cc:3037] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:02.945060 22269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd04c16c28f412e81468de3fb4e346e" candidate_uuid: "a93074069de540c88268f82659df6c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0c3be4cb71347219055b6cd5d09733a" is_pre_election: true
I20260808 10:02:02.945413 22800 leader_election.cc:288] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [CANDIDATE]: Term 1 election: Requested vote from peers e0c3be4cb71347219055b6cd5d09733a (127.24.71.193:42289), a93074069de540c88268f82659df6c06 (127.24.71.195:39311)
I20260808 10:02:02.945919 22270 raft_consensus.cc:2454] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69daffabd4394319b905e00a79fed3e4 in term 1.
I20260808 10:02:02.946134 22373 leader_election.cc:302] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69daffabd4394319b905e00a79fed3e4, e0c3be4cb71347219055b6cd5d09733a; no voters:
I20260808 10:02:02.946128 22585 leader_election.cc:302] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a93074069de540c88268f82659df6c06; no voters: 69daffabd4394319b905e00a79fed3e4, e0c3be4cb71347219055b6cd5d09733a
I20260808 10:02:02.946216 22800 raft_consensus.cc:2781] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:02.946213 22685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd04c16c28f412e81468de3fb4e346e" candidate_uuid: "69daffabd4394319b905e00a79fed3e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a93074069de540c88268f82659df6c06"
I20260808 10:02:02.946281 22685 raft_consensus.cc:3037] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:02.946403 22800 raft_consensus.cc:686] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 1 LEADER]: Becoming Leader. State: Replica: 69daffabd4394319b905e00a79fed3e4, State: Running, Role: LEADER
I20260808 10:02:02.946501 22800 consensus_queue.cc:237] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69daffabd4394319b905e00a79fed3e4" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43977 } } peers { permanent_uuid: "e0c3be4cb71347219055b6cd5d09733a" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42289 } } peers { permanent_uuid: "a93074069de540c88268f82659df6c06" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 39311 } }
I20260808 10:02:02.947182 22685 raft_consensus.cc:2454] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69daffabd4394319b905e00a79fed3e4 in term 1.
I20260808 10:02:02.947314 22803 raft_consensus.cc:2726] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 10:02:02.947806 22045 catalog_manager.cc:5495] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69daffabd4394319b905e00a79fed3e4 (127.24.71.194). New cstate: current_term: 1 leader_uuid: "69daffabd4394319b905e00a79fed3e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69daffabd4394319b905e00a79fed3e4" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0c3be4cb71347219055b6cd5d09733a" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a93074069de540c88268f82659df6c06" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 39311 } health_report { overall_health: UNKNOWN } } }
W20260808 10:02:02.958839 22554 tablet.cc:2369] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:02:02.962634 22785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.960407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53604 (local address 127.24.71.194:43977)
0808 10:02:02.960475 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:02.960477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:02.960486 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:02:02.960552 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:02.960553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:02.960570 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:02.960631 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:02:02.960752 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.961215 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.961960 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:02.962140 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:02.962191 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:02.962336 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:02.962442 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:02.962502 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:02.962538 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 10:02:02.962556 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 10:02:02.964498 22270 raft_consensus.cc:1261] T 0fd04c16c28f412e81468de3fb4e346e P e0c3be4cb71347219055b6cd5d09733a [term 1 FOLLOWER]: Refusing update from remote peer 69daffabd4394319b905e00a79fed3e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:02:02.964537 22685 raft_consensus.cc:1261] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [term 1 FOLLOWER]: Refusing update from remote peer 69daffabd4394319b905e00a79fed3e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:02:02.964871 22808 consensus_queue.cc:1035] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a93074069de540c88268f82659df6c06" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 39311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:02:02.965026 22800 consensus_queue.cc:1035] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0c3be4cb71347219055b6cd5d09733a" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:02:02.967635 22812 mvcc.cc:205] Tried to move back new op lower bound from 7316206890859696128 to 7316206890789539840. Current Snapshot: MvccSnapshot[applied={T|T < 7316206890859696128}]
I20260808 10:02:02.970701 22043 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:02:02.970820 22043 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:02:02.971755 22043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c5af8dd504e4cf19f7570b7de7b1f99: Sending DeleteTablet for 3 replicas of tablet 0fd04c16c28f412e81468de3fb4e346e
I20260808 10:02:02.972105 22242 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fd04c16c28f412e81468de3fb4e346e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:02:02 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:60312
I20260808 10:02:02.972402 22659 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fd04c16c28f412e81468de3fb4e346e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:02:02 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:36196
I20260808 10:02:02.972429 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 22138
I20260808 10:02:02.972630 22452 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fd04c16c28f412e81468de3fb4e346e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:02:02 UTC) from {username='kudu', principal='kudu/127.24.71.254@KRBTEST.COM'} at 127.0.0.1:53594
I20260808 10:02:02.978442 22830 tablet_replica.cc:330] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4: stopping tablet replica
I20260808 10:02:02.978590 22830 raft_consensus.cc:2229] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 10:02:02.978744 22830 raft_consensus.cc:2258] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:02:02.981034 22830 ts_tablet_manager.cc:1905] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:02:02.982816 22830 ts_tablet_manager.cc:1918] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:02:02.982893 22830 log.cc:1196] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/0fd04c16c28f412e81468de3fb4e346e
I20260808 10:02:02.983182 22830 ts_tablet_manager.cc:1939] T 0fd04c16c28f412e81468de3fb4e346e P 69daffabd4394319b905e00a79fed3e4: Deleting consensus metadata
I20260808 10:02:02.983742 22826 tablet_replica.cc:330] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06: stopping tablet replica
I20260808 10:02:02.983879 22826 raft_consensus.cc:2229] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:02:02.984000 22826 raft_consensus.cc:2258] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:02:02.984776 22826 ts_tablet_manager.cc:1905] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:02:02.985877 22023 catalog_manager.cc:4841] TS 69daffabd4394319b905e00a79fed3e4 (127.24.71.194:43977): tablet 0fd04c16c28f412e81468de3fb4e346e (table test-table [id=a832888d998e4bc7834e1fc1952cece8]) successfully deleted
I20260808 10:02:02.986768 22826 ts_tablet_manager.cc:1918] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:02:02.986840 22826 log.cc:1196] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/0fd04c16c28f412e81468de3fb4e346e
I20260808 10:02:02.987124 22826 ts_tablet_manager.cc:1939] T 0fd04c16c28f412e81468de3fb4e346e P a93074069de540c88268f82659df6c06: Deleting consensus metadata
I20260808 10:02:02.988004 22021 catalog_manager.cc:4841] TS a93074069de540c88268f82659df6c06 (127.24.71.195:39311): tablet 0fd04c16c28f412e81468de3fb4e346e (table test-table [id=a832888d998e4bc7834e1fc1952cece8]) successfully deleted
W20260808 10:02:02.992600 22021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:42289 (error 108)
I20260808 10:02:02.993249 22783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:02.993096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:42289 (local address 127.0.0.1:60324)
0808 10:02:02.993160 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:02.993211 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:42289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 10:02:02.993335 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 22345
W20260808 10:02:02.996328 22021 catalog_manager.cc:4584] TS e0c3be4cb71347219055b6cd5d09733a (127.24.71.193:42289): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0fd04c16c28f412e81468de3fb4e346e: Network error: Client connection negotiation failed: client connection to 127.24.71.193:42289: connect: Connection refused (error 111)
I20260808 10:02:03.004484 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 22558
I20260808 10:02:03.019869 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 21988
2026-08-08T10:02:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2192 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T10:02:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:03Z Disabled control of system clock
I20260808 10:02:03.056210 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:36645
--webserver_interface=127.24.71.254
--webserver_port=0
--builtin_ntp_servers=127.24.71.212:41967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:36645
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 10:02:03.145694 22838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:03.145949 22838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:03.145972 22838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:03.147238 22838 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:03.147286 22838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:03.147300 22838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:03.147312 22838 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:03.147324 22838 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:03.148841 22838 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:36645
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:36645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:03.149147 22838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:03.149501 22838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:03.154745 22847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:03.154819 22838 server_base.cc:1034] running on GCE node
W20260808 10:02:03.154791 22850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:03.154798 22853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:03.155164 22838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:03.155521 22838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:03.156762 22838 hybrid_clock.cc:648] HybridClock initialized: now 1786183323156733 us; error 40 us; skew 500 ppm
I20260808 10:02:03.158239 22838 webserver.cc:460] Webserver started at http://127.24.71.254:33839/ using document root <none> and password file <none>
I20260808 10:02:03.158556 22838 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:03.158632 22838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:03.158788 22838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:03.159986 22838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "7a84e1605c2941eebeea40b00f6fc83b"
format_stamp: "Formatted at 2026-08-08 10:02:03 on dist-test-slave-gw5c"
server_key: "8686e7a19f8aea0123e9bd863e1b94cb"
server_key_iv: "62fec350fa433376e9b3cea9b6204f53"
server_key_version: "encryptionkey@0"
I20260808 10:02:03.160383 22838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "7a84e1605c2941eebeea40b00f6fc83b"
format_stamp: "Formatted at 2026-08-08 10:02:03 on dist-test-slave-gw5c"
server_key: "8686e7a19f8aea0123e9bd863e1b94cb"
server_key_iv: "62fec350fa433376e9b3cea9b6204f53"
server_key_version: "encryptionkey@0"
I20260808 10:02:03.161728 22838 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:02:03.162567 22866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:03.162750 22838 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:03.162859 22838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "7a84e1605c2941eebeea40b00f6fc83b"
format_stamp: "Formatted at 2026-08-08 10:02:03 on dist-test-slave-gw5c"
server_key: "8686e7a19f8aea0123e9bd863e1b94cb"
server_key_iv: "62fec350fa433376e9b3cea9b6204f53"
server_key_version: "encryptionkey@0"
I20260808 10:02:03.162936 22838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:03.173929 22838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:03.174297 22838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:03.174463 22838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:03.178859 22838 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:36645
I20260808 10:02:03.178898 22947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:36645 every 8 connection(s)
I20260808 10:02:03.179280 22838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:03.180315 22948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:03.181142 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 22838
I20260808 10:02:03.181272 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:03.181466 24863 external_mini_cluster.cc:1428] Setting key acaccd8bb5a0c02b09c397ac1431bee1
I20260808 10:02:03.183770 22948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b: Bootstrap starting.
I20260808 10:02:03.184513 22948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:03.184834 22948 log.cc:824] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:03.185645 22948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b: No bootstrap required, opened a new log
I20260808 10:02:03.187785 22954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.182042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52754 (local address 127.24.71.254:36645)
0808 10:02:03.182264 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:03.182274 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:03.182306 (+ 32us) server_negotiation.cc:407] Connection header received
0808 10:02:03.182827 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:03.182836 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:03.182924 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:03.183075 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:03.183263 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.184608 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.185430 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.186033 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.186168 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.186896 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:03.186902 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:03.186902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:03.187132 (+ 230us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:03.187177 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:03.187192 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:03.187266 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:03.187458 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 10:02:03.187553 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":81,"threads_started":1}
I20260808 10:02:03.188541 22948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a84e1605c2941eebeea40b00f6fc83b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 36645 } }
I20260808 10:02:03.188704 22948 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:03.188727 22948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a84e1605c2941eebeea40b00f6fc83b, State: Initialized, Role: FOLLOWER
I20260808 10:02:03.188859 22948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a84e1605c2941eebeea40b00f6fc83b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 36645 } }
I20260808 10:02:03.188941 22948 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:03.188964 22948 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:03.188993 22948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:03.189560 22948 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a84e1605c2941eebeea40b00f6fc83b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 36645 } }
I20260808 10:02:03.189651 22948 leader_election.cc:302] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a84e1605c2941eebeea40b00f6fc83b; no voters:
I20260808 10:02:03.189800 22948 leader_election.cc:288] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:03.189908 22956 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:03.190099 22956 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [term 1 LEADER]: Becoming Leader. State: Replica: 7a84e1605c2941eebeea40b00f6fc83b, State: Running, Role: LEADER
I20260808 10:02:03.190157 22948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:03.190196 22956 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a84e1605c2941eebeea40b00f6fc83b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 36645 } }
I20260808 10:02:03.190603 22957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a84e1605c2941eebeea40b00f6fc83b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a84e1605c2941eebeea40b00f6fc83b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 36645 } } }
I20260808 10:02:03.190608 22958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a84e1605c2941eebeea40b00f6fc83b. Latest consensus state: current_term: 1 leader_uuid: "7a84e1605c2941eebeea40b00f6fc83b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a84e1605c2941eebeea40b00f6fc83b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 36645 } } }
I20260808 10:02:03.190825 22958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:03.191205 22957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:03.191268 22977 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:03.191886 22977 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:03.193565 22977 catalog_manager.cc:1347] Generated new cluster ID: 83054294090c4ce8a8ea6983ff8a02c4
I20260808 10:02:03.193622 22977 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:03.208806 22977 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:03.209404 22977 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:03.216332 22977 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b: Generated new TSK 0
I20260808 10:02:03.216547 22977 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:03.220158 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.193:0
--local_ip_for_outbound_sockets=127.24.71.193
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:36645
--builtin_ntp_servers=127.24.71.212:41967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 10:02:03.323985 22995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:03.324218 22995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:03.324241 22995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:03.325459 22995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:03.325505 22995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:03.325532 22995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.193
I20260808 10:02:03.327025 22995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.71.193
--webserver_port=0
--tserver_master_addrs=127.24.71.254:36645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.193
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:03.327291 22995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:03.327644 22995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:03.333813 23009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:03.333956 23008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:03.333808 23011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:03.334124 22995 server_base.cc:1034] running on GCE node
I20260808 10:02:03.334358 22995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:03.334621 22995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:03.335800 22995 hybrid_clock.cc:648] HybridClock initialized: now 1786183323335785 us; error 29 us; skew 500 ppm
I20260808 10:02:03.337476 22995 webserver.cc:460] Webserver started at http://127.24.71.193:35151/ using document root <none> and password file <none>
I20260808 10:02:03.337756 22995 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:03.337827 22995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:03.337970 22995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:03.339452 22995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/data/instance:
uuid: "c7197b0d69b44127bc1fc2bf9e106119"
format_stamp: "Formatted at 2026-08-08 10:02:03 on dist-test-slave-gw5c"
server_key: "13cfed23f5e5df969614dbff40545275"
server_key_iv: "4abfb79d54971f44d51ac8712e6fce59"
server_key_version: "encryptionkey@0"
I20260808 10:02:03.339888 22995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance:
uuid: "c7197b0d69b44127bc1fc2bf9e106119"
format_stamp: "Formatted at 2026-08-08 10:02:03 on dist-test-slave-gw5c"
server_key: "13cfed23f5e5df969614dbff40545275"
server_key_iv: "4abfb79d54971f44d51ac8712e6fce59"
server_key_version: "encryptionkey@0"
I20260808 10:02:03.341567 22995 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 10:02:03.342491 23017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:03.342706 22995 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:03.342824 22995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/wal
uuid: "c7197b0d69b44127bc1fc2bf9e106119"
format_stamp: "Formatted at 2026-08-08 10:02:03 on dist-test-slave-gw5c"
server_key: "13cfed23f5e5df969614dbff40545275"
server_key_iv: "4abfb79d54971f44d51ac8712e6fce59"
server_key_version: "encryptionkey@0"
I20260808 10:02:03.342904 22995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:03.375773 22995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:03.376252 22995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:03.376415 22995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:03.376719 22995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:02:03.377170 22995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:02:03.377251 22995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:03.377295 22995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:02:03.377315 22995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:03.383852 22995 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.193:46743
I20260808 10:02:03.383901 23191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.193:46743 every 8 connection(s)
I20260808 10:02:03.384266 22995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/data/info.pb
I20260808 10:02:03.387612 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 22995
I20260808 10:02:03.387734 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-0/wal/instance
I20260808 10:02:03.387946 24863 external_mini_cluster.cc:1428] Setting key 39e5c709dfcff5bcbc3ef1d56a7e785f
I20260808 10:02:03.389060 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.194:0
--local_ip_for_outbound_sockets=127.24.71.194
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:36645
--builtin_ntp_servers=127.24.71.212:41967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 10:02:03.390028 22954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.385051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:42413 (local address 127.24.71.254:36645)
0808 10:02:03.385125 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:03.385127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:03.385387 (+ 260us) server_negotiation.cc:407] Connection header received
0808 10:02:03.385882 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:03.385883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:03.385900 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:03.385968 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:03.386650 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.387170 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.388390 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.388644 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.388720 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.389747 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:03.389748 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:03.389749 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:03.389752 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:03.389765 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:03.389769 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:03.389813 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:03.389938 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 10:02:03.389968 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 10:02:03.390391 23194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.385037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:36645 (local address 127.24.71.193:42413)
0808 10:02:03.385244 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:03.385291 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:03.385796 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:03.386020 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:03.386024 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:03.386032 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:03.386555 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.386559 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.387257 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.387258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.388301 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.388304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.388750 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.388752 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.388926 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.389591 (+ 665us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 10:02:03.389591 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:03.389630 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 10:02:03.389660 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:03.389816 (+ 156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:03.389820 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:03.389823 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 10:02:03.389937 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 10:02:03.390056 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":86,"threads_started":1}
I20260808 10:02:03.391036 23192 heartbeater.cc:347] Connected to a master server at 127.24.71.254:36645
I20260808 10:02:03.391150 23192 heartbeater.cc:464] Registering TS with master...
I20260808 10:02:03.391462 23192 heartbeater.cc:511] Master 127.24.71.254:36645 requested a full tablet report, sending...
I20260808 10:02:03.392153 22894 ts_manager.cc:194] Registered new tserver with Master: c7197b0d69b44127bc1fc2bf9e106119 (127.24.71.193:46743)
I20260808 10:02:03.393112 22894 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.71.193:42413
W20260808 10:02:03.476401 23196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:03.476617 23196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:03.476640 23196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:03.477732 23196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:03.477767 23196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:03.477792 23196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.194
I20260808 10:02:03.479120 23196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.71.194
--webserver_port=0
--tserver_master_addrs=127.24.71.254:36645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.194
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:03.479321 23196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:03.479657 23196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:03.484747 23201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:03.484757 23204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:03.484764 23202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:03.484983 23196 server_base.cc:1034] running on GCE node
I20260808 10:02:03.485284 23196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:03.485531 23196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:03.486699 23196 hybrid_clock.cc:648] HybridClock initialized: now 1786183323486679 us; error 31 us; skew 500 ppm
I20260808 10:02:03.488054 23196 webserver.cc:460] Webserver started at http://127.24.71.194:37591/ using document root <none> and password file <none>
I20260808 10:02:03.488312 23196 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:03.488381 23196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:03.488545 23196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:03.489639 23196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/data/instance:
uuid: "6c689dd609df43678dc145e4cb82d0e7"
format_stamp: "Formatted at 2026-08-08 10:02:03 on dist-test-slave-gw5c"
server_key: "a1005990df2501a008a9e0f64611252d"
server_key_iv: "bca0b1643fed033a577aed04d1afd9fd"
server_key_version: "encryptionkey@0"
I20260808 10:02:03.490034 23196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance:
uuid: "6c689dd609df43678dc145e4cb82d0e7"
format_stamp: "Formatted at 2026-08-08 10:02:03 on dist-test-slave-gw5c"
server_key: "a1005990df2501a008a9e0f64611252d"
server_key_iv: "bca0b1643fed033a577aed04d1afd9fd"
server_key_version: "encryptionkey@0"
I20260808 10:02:03.491652 23196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260808 10:02:03.492372 23210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:03.492540 23196 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:02:03.492612 23196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/wal
uuid: "6c689dd609df43678dc145e4cb82d0e7"
format_stamp: "Formatted at 2026-08-08 10:02:03 on dist-test-slave-gw5c"
server_key: "a1005990df2501a008a9e0f64611252d"
server_key_iv: "bca0b1643fed033a577aed04d1afd9fd"
server_key_version: "encryptionkey@0"
I20260808 10:02:03.492668 23196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:03.501487 23196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:03.501749 23196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:03.501852 23196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:03.502045 23196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:02:03.502424 23196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:02:03.502485 23196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:03.502529 23196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:02:03.502556 23196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:03.508948 23196 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.194:44245
I20260808 10:02:03.508999 23380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.194:44245 every 8 connection(s)
I20260808 10:02:03.509339 23196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/data/info.pb
I20260808 10:02:03.514794 22954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.510129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.194:58823 (local address 127.24.71.254:36645)
0808 10:02:03.510202 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:03.510204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:03.510455 (+ 251us) server_negotiation.cc:407] Connection header received
0808 10:02:03.511024 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:03.511026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:03.511040 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:03.511092 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:03.511880 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.512387 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.513395 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.513615 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.513705 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.514505 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:03.514507 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:03.514507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:03.514512 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:03.514528 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:03.514532 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:03.514587 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:03.514681 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 10:02:03.514714 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 10:02:03.515041 23384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.510108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:36645 (local address 127.24.71.194:58823)
0808 10:02:03.510332 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:03.510368 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:03.510894 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:03.511165 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:03.511169 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:03.511177 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:03.511783 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.511788 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.512499 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.512501 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.513298 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.513300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.513721 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.513722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.513853 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.514364 (+ 511us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 10:02:03.514365 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:03.514392 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 10:02:03.514416 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:03.514590 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:03.514595 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:03.514598 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 10:02:03.514682 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 10:02:03.514785 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":92,"threads_started":1}
I20260808 10:02:03.515652 23382 heartbeater.cc:347] Connected to a master server at 127.24.71.254:36645
I20260808 10:02:03.515736 23382 heartbeater.cc:464] Registering TS with master...
I20260808 10:02:03.515937 23382 heartbeater.cc:511] Master 127.24.71.254:36645 requested a full tablet report, sending...
I20260808 10:02:03.516359 22894 ts_manager.cc:194] Registered new tserver with Master: 6c689dd609df43678dc145e4cb82d0e7 (127.24.71.194:44245)
I20260808 10:02:03.516363 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 23196
I20260808 10:02:03.516484 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/wal/instance
I20260808 10:02:03.516698 24863 external_mini_cluster.cc:1428] Setting key 8b2a73baf50f2b8a2283cadc6c3b0f07
I20260808 10:02:03.516858 22894 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.71.194:58823
I20260808 10:02:03.517633 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.71.195:0
--local_ip_for_outbound_sockets=127.24.71.195
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:36645
--builtin_ntp_servers=127.24.71.212:41967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 10:02:03.601559 23385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:03.601784 23385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:03.601807 23385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:03.602921 23385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:03.602954 23385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:03.602979 23385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.71.195
I20260808 10:02:03.604302 23385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:41967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.71.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.71.195
--webserver_port=0
--tserver_master_addrs=127.24.71.254:36645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.71.195
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:03.604512 23385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:03.604771 23385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:03.610090 23396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:03.610108 23393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:03.610102 23394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:03.610280 23385 server_base.cc:1034] running on GCE node
I20260808 10:02:03.610546 23385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:03.610803 23385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:03.611976 23385 hybrid_clock.cc:648] HybridClock initialized: now 1786183323611960 us; error 28 us; skew 500 ppm
I20260808 10:02:03.613360 23385 webserver.cc:460] Webserver started at http://127.24.71.195:43749/ using document root <none> and password file <none>
I20260808 10:02:03.613607 23385 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:03.613675 23385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:03.613840 23385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:03.614984 23385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/data/instance:
uuid: "02ac33eb6ec84985abb5608ea1511d70"
format_stamp: "Formatted at 2026-08-08 10:02:03 on dist-test-slave-gw5c"
server_key: "37718e562a36d9ff0c5d57401e92a82e"
server_key_iv: "fca0a0bf601491136363997c4125f18b"
server_key_version: "encryptionkey@0"
I20260808 10:02:03.615355 23385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance:
uuid: "02ac33eb6ec84985abb5608ea1511d70"
format_stamp: "Formatted at 2026-08-08 10:02:03 on dist-test-slave-gw5c"
server_key: "37718e562a36d9ff0c5d57401e92a82e"
server_key_iv: "fca0a0bf601491136363997c4125f18b"
server_key_version: "encryptionkey@0"
I20260808 10:02:03.616722 23385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:02:03.617506 23406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:03.617686 23385 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 10:02:03.617790 23385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/wal
uuid: "02ac33eb6ec84985abb5608ea1511d70"
format_stamp: "Formatted at 2026-08-08 10:02:03 on dist-test-slave-gw5c"
server_key: "37718e562a36d9ff0c5d57401e92a82e"
server_key_iv: "fca0a0bf601491136363997c4125f18b"
server_key_version: "encryptionkey@0"
I20260808 10:02:03.617874 23385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:03.631887 23385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:03.632239 23385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:03.632401 23385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:03.632671 23385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 10:02:03.633033 23385 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 10:02:03.633105 23385 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:03.633150 23385 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 10:02:03.633173 23385 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:03.639230 23385 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.195:32873
I20260808 10:02:03.639278 23569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.195:32873 every 8 connection(s)
I20260808 10:02:03.639698 23385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/data/info.pb
I20260808 10:02:03.643381 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 23385
I20260808 10:02:03.643527 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/wal/instance
I20260808 10:02:03.643721 24863 external_mini_cluster.cc:1428] Setting key 1d5ba47c001cf3d526777d6a34b88204
I20260808 10:02:03.645207 22954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.640452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.195:36179 (local address 127.24.71.254:36645)
0808 10:02:03.640536 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:03.640538 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:03.640741 (+ 203us) server_negotiation.cc:407] Connection header received
0808 10:02:03.641246 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:03.641247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:03.641257 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:03.641339 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:03.642017 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.642522 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.643551 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.643801 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.643868 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.644949 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:03.644950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:03.644951 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:03.644955 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:03.644971 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:03.644975 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:03.645020 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:03.645118 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 10:02:03.645148 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 10:02:03.645428 23572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.640403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:36645 (local address 127.24.71.195:36179)
0808 10:02:03.640611 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:03.640656 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:03.641161 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:03.641407 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:03.641410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:03.641419 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:03.641944 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.641949 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.642620 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.642621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.643446 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.643448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.643961 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.643962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.644127 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.644803 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 10:02:03.644804 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:03.644833 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 10:02:03.644856 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:03.645043 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:03.645047 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:03.645050 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 10:02:03.645122 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 10:02:03.645206 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":96,"threads_started":1}
I20260808 10:02:03.645884 23570 heartbeater.cc:347] Connected to a master server at 127.24.71.254:36645
I20260808 10:02:03.645982 23570 heartbeater.cc:464] Registering TS with master...
I20260808 10:02:03.646243 23570 heartbeater.cc:511] Master 127.24.71.254:36645 requested a full tablet report, sending...
I20260808 10:02:03.646603 22894 ts_manager.cc:194] Registered new tserver with Master: 02ac33eb6ec84985abb5608ea1511d70 (127.24.71.195:32873)
I20260808 10:02:03.646987 22894 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.71.195:36179
I20260808 10:02:03.655696 24863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 10:02:03.660247 22954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.657162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52770 (local address 127.24.71.254:36645)
0808 10:02:03.657233 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:03.657235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:03.657332 (+ 97us) server_negotiation.cc:407] Connection header received
0808 10:02:03.657427 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:03.657429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:03.657439 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:03.657496 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:03.657675 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.658165 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.658938 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.659148 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.659227 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.659975 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:03.659976 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:03.659976 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:03.659983 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:03.660001 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:03.660005 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:03.660062 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:03.660125 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 10:02:03.660148 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 10:02:03.661906 22894 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52770:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 10:02:03.663563 22894 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 10:02:03.670348 23585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.666274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54792 (local address 127.24.71.194:44245)
0808 10:02:03.666499 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:03.666522 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:03.666533 (+ 11us) server_negotiation.cc:407] Connection header received
0808 10:02:03.666574 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:03.666576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:03.666592 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:03.666675 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:03.666883 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.668019 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.669343 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.669936 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.670029 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.670131 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:03.670211 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 10:02:03.670251 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":124,"threads_started":1}
I20260808 10:02:03.670334 23580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.665911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:44245 (local address 127.0.0.1:54792)
0808 10:02:03.666181 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:03.666192 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:03.666248 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:03.666736 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:03.666737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:03.666739 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:03.666794 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.666796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.668098 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.668099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.669245 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.669248 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.670028 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.670029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.670104 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.670117 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 10:02:03.670196 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 10:02:03.670251 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":3,"thread_start_us":65,"threads_started":1}
I20260808 10:02:03.670549 23579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.665886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:46743 (local address 127.0.0.1:48898)
0808 10:02:03.666043 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:03.666089 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:03.666157 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:03.666380 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:03.666383 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:03.666385 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:03.666462 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.666465 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.667884 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.667885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.669242 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.669244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.670284 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.670285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.670347 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.670351 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 10:02:03.670399 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 10:02:03.670440 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":1,"thread_start_us":59,"threads_started":1}
I20260808 10:02:03.670807 23582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.665992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48898 (local address 127.24.71.193:46743)
0808 10:02:03.666179 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:03.666184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:03.666198 (+ 14us) server_negotiation.cc:407] Connection header received
0808 10:02:03.666245 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:03.666247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:03.666264 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:03.666356 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:03.666554 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.667784 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.669335 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.670074 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.670150 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.670242 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:03.670669 (+ 427us) server_negotiation.cc:299] Negotiation successful
0808 10:02:03.670721 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":93,"threads_started":1}
I20260808 10:02:03.671208 23584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.666108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:32873 (local address 127.0.0.1:47382)
0808 10:02:03.666820 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:03.666830 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:03.666872 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:03.667197 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:03.667198 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:03.667200 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:03.667239 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.667240 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.668342 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.668343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.669454 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.669456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.670968 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.670969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.671029 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.671034 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 10:02:03.671085 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 10:02:03.671127 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":88,"threads_started":1}
I20260808 10:02:03.671239 23278 tablet_service.cc:1467] Processing CreateTablet for tablet 08a841ad0f56461fb69ad463b377d8a0 (DEFAULT_TABLE table=test-table [id=c013e6fbe8d847f485fd5780c55105a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:02:03.671519 23587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.666603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47382 (local address 127.24.71.195:32873)
0808 10:02:03.666993 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:03.666998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:03.667007 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:02:03.667046 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:03.667048 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:03.667063 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:03.667135 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:03.667312 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.668257 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.669537 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.670248 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.670311 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.671284 (+ 973us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:03.671322 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 10:02:03.671374 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":105,"threads_started":1}
I20260808 10:02:03.671492 23086 tablet_service.cc:1467] Processing CreateTablet for tablet 08a841ad0f56461fb69ad463b377d8a0 (DEFAULT_TABLE table=test-table [id=c013e6fbe8d847f485fd5780c55105a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:02:03.671691 23278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08a841ad0f56461fb69ad463b377d8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:03.671829 23086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08a841ad0f56461fb69ad463b377d8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:03.672068 23471 tablet_service.cc:1467] Processing CreateTablet for tablet 08a841ad0f56461fb69ad463b377d8a0 (DEFAULT_TABLE table=test-table [id=c013e6fbe8d847f485fd5780c55105a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 10:02:03.672317 23471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08a841ad0f56461fb69ad463b377d8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:03.675048 23588 tablet_bootstrap.cc:492] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70: Bootstrap starting.
I20260808 10:02:03.675351 23591 tablet_bootstrap.cc:492] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7: Bootstrap starting.
I20260808 10:02:03.675614 23590 tablet_bootstrap.cc:492] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119: Bootstrap starting.
I20260808 10:02:03.675897 23588 tablet_bootstrap.cc:654] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:03.676085 23591 tablet_bootstrap.cc:654] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:03.676290 23588 log.cc:824] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:03.676306 23590 tablet_bootstrap.cc:654] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:03.676443 23591 log.cc:824] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:03.676654 23590 log.cc:824] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:03.677174 23588 tablet_bootstrap.cc:492] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70: No bootstrap required, opened a new log
I20260808 10:02:03.677261 23588 ts_tablet_manager.cc:1397] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 10:02:03.677356 23590 tablet_bootstrap.cc:492] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119: No bootstrap required, opened a new log
I20260808 10:02:03.677418 23590 ts_tablet_manager.cc:1397] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 10:02:03.679279 23590 raft_consensus.cc:348] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7197b0d69b44127bc1fc2bf9e106119" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 46743 } } peers { permanent_uuid: "6c689dd609df43678dc145e4cb82d0e7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44245 } } peers { permanent_uuid: "02ac33eb6ec84985abb5608ea1511d70" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 32873 } }
I20260808 10:02:03.679298 23588 raft_consensus.cc:348] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7197b0d69b44127bc1fc2bf9e106119" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 46743 } } peers { permanent_uuid: "6c689dd609df43678dc145e4cb82d0e7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44245 } } peers { permanent_uuid: "02ac33eb6ec84985abb5608ea1511d70" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 32873 } }
I20260808 10:02:03.679478 23590 raft_consensus.cc:374] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:03.679494 23588 raft_consensus.cc:374] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:03.679528 23590 raft_consensus.cc:729] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7197b0d69b44127bc1fc2bf9e106119, State: Initialized, Role: FOLLOWER
I20260808 10:02:03.679549 23588 raft_consensus.cc:729] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02ac33eb6ec84985abb5608ea1511d70, State: Initialized, Role: FOLLOWER
I20260808 10:02:03.679651 23590 consensus_queue.cc:260] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7197b0d69b44127bc1fc2bf9e106119" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 46743 } } peers { permanent_uuid: "6c689dd609df43678dc145e4cb82d0e7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44245 } } peers { permanent_uuid: "02ac33eb6ec84985abb5608ea1511d70" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 32873 } }
I20260808 10:02:03.679678 23588 consensus_queue.cc:260] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7197b0d69b44127bc1fc2bf9e106119" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 46743 } } peers { permanent_uuid: "6c689dd609df43678dc145e4cb82d0e7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44245 } } peers { permanent_uuid: "02ac33eb6ec84985abb5608ea1511d70" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 32873 } }
I20260808 10:02:03.679956 23590 ts_tablet_manager.cc:1428] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 10:02:03.679991 23588 ts_tablet_manager.cc:1428] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 10:02:03.680011 23192 heartbeater.cc:503] Master 127.24.71.254:36645 was elected leader, sending a full tablet report...
I20260808 10:02:03.680030 23570 heartbeater.cc:503] Master 127.24.71.254:36645 was elected leader, sending a full tablet report...
I20260808 10:02:03.680406 23591 tablet_bootstrap.cc:492] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7: No bootstrap required, opened a new log
I20260808 10:02:03.680477 23591 ts_tablet_manager.cc:1397] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 10:02:03.682755 23591 raft_consensus.cc:348] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7197b0d69b44127bc1fc2bf9e106119" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 46743 } } peers { permanent_uuid: "6c689dd609df43678dc145e4cb82d0e7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44245 } } peers { permanent_uuid: "02ac33eb6ec84985abb5608ea1511d70" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 32873 } }
I20260808 10:02:03.682894 23591 raft_consensus.cc:374] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:03.682919 23591 raft_consensus.cc:729] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c689dd609df43678dc145e4cb82d0e7, State: Initialized, Role: FOLLOWER
I20260808 10:02:03.683034 23591 consensus_queue.cc:260] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7197b0d69b44127bc1fc2bf9e106119" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 46743 } } peers { permanent_uuid: "6c689dd609df43678dc145e4cb82d0e7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44245 } } peers { permanent_uuid: "02ac33eb6ec84985abb5608ea1511d70" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 32873 } }
I20260808 10:02:03.683264 23591 ts_tablet_manager.cc:1428] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 10:02:03.683379 23382 heartbeater.cc:503] Master 127.24.71.254:36645 was elected leader, sending a full tablet report...
W20260808 10:02:03.760008 23383 tablet.cc:2369] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:02:03.870561 23597 raft_consensus.cc:482] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 10:02:03.870699 23597 raft_consensus.cc:504] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7197b0d69b44127bc1fc2bf9e106119" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 46743 } } peers { permanent_uuid: "6c689dd609df43678dc145e4cb82d0e7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44245 } } peers { permanent_uuid: "02ac33eb6ec84985abb5608ea1511d70" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 32873 } }
I20260808 10:02:03.871023 23597 leader_election.cc:288] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c689dd609df43678dc145e4cb82d0e7 (127.24.71.194:44245), 02ac33eb6ec84985abb5608ea1511d70 (127.24.71.195:32873)
I20260808 10:02:03.874092 23585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.871393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:52611 (local address 127.24.71.194:44245)
0808 10:02:03.871482 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:03.871484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:03.871496 (+ 12us) server_negotiation.cc:407] Connection header received
0808 10:02:03.871534 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:03.871535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:03.871545 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:03.871627 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:03.871805 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.872356 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.873347 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.873734 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.873791 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.873798 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:03.873967 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 10:02:03.874018 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 10:02:03.874082 23194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.871258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.194:44245 (local address 127.24.71.193:52611)
0808 10:02:03.871304 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:03.871318 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:03.871372 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:03.871636 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:03.871637 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:03.871639 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:03.871725 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.871727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.872432 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.872433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.873241 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.873244 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.873810 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.873811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.873885 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.873888 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 10:02:03.873942 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 10:02:03.873976 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20,"mutex_wait_us":14}
I20260808 10:02:03.874157 23587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.871547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.71.193:56985 (local address 127.24.71.195:32873)
0808 10:02:03.871602 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:03.871604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:03.871615 (+ 11us) server_negotiation.cc:407] Connection header received
0808 10:02:03.871703 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:03.871705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:03.871714 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:03.871794 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 10:02:03.871960 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.872448 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.873383 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.873747 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.873844 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.873851 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:03.874040 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 10:02:03.874078 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 10:02:03.874207 23603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.871381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.195:32873 (local address 127.24.71.193:56985)
0808 10:02:03.871561 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:03.871572 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:03.871623 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:03.871804 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:03.871805 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:03.871806 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 10:02:03.871882 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.871884 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.872528 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.872528 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.873264 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:03.873266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.873865 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.873866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:03.873951 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.873957 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 10:02:03.874014 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 10:02:03.874050 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":135,"threads_started":1}
I20260808 10:02:03.874833 23499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08a841ad0f56461fb69ad463b377d8a0" candidate_uuid: "c7197b0d69b44127bc1fc2bf9e106119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02ac33eb6ec84985abb5608ea1511d70" is_pre_election: true
I20260808 10:02:03.874884 23303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08a841ad0f56461fb69ad463b377d8a0" candidate_uuid: "c7197b0d69b44127bc1fc2bf9e106119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c689dd609df43678dc145e4cb82d0e7" is_pre_election: true
I20260808 10:02:03.875010 23499 raft_consensus.cc:2454] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7197b0d69b44127bc1fc2bf9e106119 in term 0.
I20260808 10:02:03.875087 23303 raft_consensus.cc:2454] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7197b0d69b44127bc1fc2bf9e106119 in term 0.
I20260808 10:02:03.875264 23019 leader_election.cc:302] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02ac33eb6ec84985abb5608ea1511d70, c7197b0d69b44127bc1fc2bf9e106119; no voters:
I20260808 10:02:03.875428 23597 raft_consensus.cc:2781] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 10:02:03.875502 23597 raft_consensus.cc:482] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 10:02:03.875525 23597 raft_consensus.cc:3037] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:03.876302 23597 raft_consensus.cc:504] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7197b0d69b44127bc1fc2bf9e106119" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 46743 } } peers { permanent_uuid: "6c689dd609df43678dc145e4cb82d0e7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44245 } } peers { permanent_uuid: "02ac33eb6ec84985abb5608ea1511d70" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 32873 } }
I20260808 10:02:03.876438 23597 leader_election.cc:288] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [CANDIDATE]: Term 1 election: Requested vote from peers 6c689dd609df43678dc145e4cb82d0e7 (127.24.71.194:44245), 02ac33eb6ec84985abb5608ea1511d70 (127.24.71.195:32873)
I20260808 10:02:03.876768 23303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08a841ad0f56461fb69ad463b377d8a0" candidate_uuid: "c7197b0d69b44127bc1fc2bf9e106119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c689dd609df43678dc145e4cb82d0e7"
I20260808 10:02:03.876768 23499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08a841ad0f56461fb69ad463b377d8a0" candidate_uuid: "c7197b0d69b44127bc1fc2bf9e106119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02ac33eb6ec84985abb5608ea1511d70"
I20260808 10:02:03.876852 23499 raft_consensus.cc:3037] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:03.876852 23303 raft_consensus.cc:3037] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:03.877821 23303 raft_consensus.cc:2454] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7197b0d69b44127bc1fc2bf9e106119 in term 1.
I20260808 10:02:03.877820 23499 raft_consensus.cc:2454] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7197b0d69b44127bc1fc2bf9e106119 in term 1.
I20260808 10:02:03.877996 23019 leader_election.cc:302] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c689dd609df43678dc145e4cb82d0e7, c7197b0d69b44127bc1fc2bf9e106119; no voters:
I20260808 10:02:03.878103 23597 raft_consensus.cc:2781] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:03.878257 23597 raft_consensus.cc:686] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [term 1 LEADER]: Becoming Leader. State: Replica: c7197b0d69b44127bc1fc2bf9e106119, State: Running, Role: LEADER
I20260808 10:02:03.878367 23597 consensus_queue.cc:237] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7197b0d69b44127bc1fc2bf9e106119" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 46743 } } peers { permanent_uuid: "6c689dd609df43678dc145e4cb82d0e7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44245 } } peers { permanent_uuid: "02ac33eb6ec84985abb5608ea1511d70" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 32873 } }
I20260808 10:02:03.879269 22894 catalog_manager.cc:5495] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7197b0d69b44127bc1fc2bf9e106119 (127.24.71.193). New cstate: current_term: 1 leader_uuid: "c7197b0d69b44127bc1fc2bf9e106119" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7197b0d69b44127bc1fc2bf9e106119" member_type: VOTER last_known_addr { host: "127.24.71.193" port: 46743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c689dd609df43678dc145e4cb82d0e7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02ac33eb6ec84985abb5608ea1511d70" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 32873 } health_report { overall_health: UNKNOWN } } }
W20260808 10:02:03.885017 23193 tablet.cc:2369] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 10:02:03.890190 23571 tablet.cc:2369] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 10:02:03.896795 23582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.894136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48906 (local address 127.24.71.193:46743)
0808 10:02:03.894201 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:03.894204 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:03.894213 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:02:03.894263 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:03.894264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:03.894283 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:03.894362 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:02:03.894533 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.895073 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.895975 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:03.896168 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:03.896241 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:03.896444 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:03.896545 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:03.896644 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:03.896663 (+ 19us) server_negotiation.cc:299] Negotiation successful
0808 10:02:03.896687 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 10:02:03.898761 23303 raft_consensus.cc:1261] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7 [term 1 FOLLOWER]: Refusing update from remote peer c7197b0d69b44127bc1fc2bf9e106119: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:02:03.898775 23499 raft_consensus.cc:1261] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70 [term 1 FOLLOWER]: Refusing update from remote peer c7197b0d69b44127bc1fc2bf9e106119: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:02:03.899183 23597 consensus_queue.cc:1035] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02ac33eb6ec84985abb5608ea1511d70" member_type: VOTER last_known_addr { host: "127.24.71.195" port: 32873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:02:03.899346 23604 consensus_queue.cc:1035] T 08a841ad0f56461fb69ad463b377d8a0 P c7197b0d69b44127bc1fc2bf9e106119 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c689dd609df43678dc145e4cb82d0e7" member_type: VOTER last_known_addr { host: "127.24.71.194" port: 44245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:02:03.902087 23613 mvcc.cc:205] Tried to move back new op lower bound from 7316206894686486528 to 7316206894606700544. Current Snapshot: MvccSnapshot[applied={T|T < 7316206894686486528}]
I20260808 10:02:03.909915 22894 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:02:03.910049 22894 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 10:02:03.910953 22894 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7a84e1605c2941eebeea40b00f6fc83b: Sending DeleteTablet for 3 replicas of tablet 08a841ad0f56461fb69ad463b377d8a0
I20260808 10:02:03.911346 23086 tablet_service.cc:1514] Processing DeleteTablet for tablet 08a841ad0f56461fb69ad463b377d8a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:02:03 UTC) from {username='slave'} at 127.0.0.1:48898
I20260808 10:02:03.911489 23278 tablet_service.cc:1514] Processing DeleteTablet for tablet 08a841ad0f56461fb69ad463b377d8a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:02:03 UTC) from {username='slave'} at 127.0.0.1:54792
I20260808 10:02:03.911787 23623 tablet_replica.cc:330] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7: stopping tablet replica
I20260808 10:02:03.911801 23471 tablet_service.cc:1514] Processing DeleteTablet for tablet 08a841ad0f56461fb69ad463b377d8a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 10:02:03 UTC) from {username='slave'} at 127.0.0.1:47382
I20260808 10:02:03.911885 23623 raft_consensus.cc:2229] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:02:03.912001 23623 raft_consensus.cc:2258] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:02:03.912083 23625 tablet_replica.cc:330] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70: stopping tablet replica
I20260808 10:02:03.912194 23625 raft_consensus.cc:2229] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 10:02:03.912299 23625 raft_consensus.cc:2258] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 10:02:03.912626 23623 ts_tablet_manager.cc:1905] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:02:03.912833 23625 ts_tablet_manager.cc:1905] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 10:02:03.912844 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 22995
I20260808 10:02:03.914669 23625 ts_tablet_manager.cc:1918] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:02:03.914669 23623 ts_tablet_manager.cc:1918] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 10:02:03.914743 23623 log.cc:1196] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-1/wal/wals/08a841ad0f56461fb69ad463b377d8a0
I20260808 10:02:03.914743 23625 log.cc:1196] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70: Deleting WAL directory at /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786183068256695-24863-0/minicluster-data/ts-2/wal/wals/08a841ad0f56461fb69ad463b377d8a0
I20260808 10:02:03.915019 23623 ts_tablet_manager.cc:1939] T 08a841ad0f56461fb69ad463b377d8a0 P 6c689dd609df43678dc145e4cb82d0e7: Deleting consensus metadata
I20260808 10:02:03.915037 23625 ts_tablet_manager.cc:1939] T 08a841ad0f56461fb69ad463b377d8a0 P 02ac33eb6ec84985abb5608ea1511d70: Deleting consensus metadata
I20260808 10:02:03.919100 22867 catalog_manager.cc:4841] TS 6c689dd609df43678dc145e4cb82d0e7 (127.24.71.194:44245): tablet 08a841ad0f56461fb69ad463b377d8a0 (table test-table [id=c013e6fbe8d847f485fd5780c55105a1]) successfully deleted
I20260808 10:02:03.919255 22867 catalog_manager.cc:4841] TS 02ac33eb6ec84985abb5608ea1511d70 (127.24.71.195:32873): tablet 08a841ad0f56461fb69ad463b377d8a0 (table test-table [id=c013e6fbe8d847f485fd5780c55105a1]) successfully deleted
W20260808 10:02:03.925307 22868 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.71.193:46743 (error 108)
I20260808 10:02:03.925534 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 23196
I20260808 10:02:03.930485 23584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:03.930313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.193:46743 (local address 127.0.0.1:48910)
0808 10:02:03.930379 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:03.930448 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.193:46743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 10:02:03.930655 22868 catalog_manager.cc:4584] TS c7197b0d69b44127bc1fc2bf9e106119 (127.24.71.193:46743): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 08a841ad0f56461fb69ad463b377d8a0: Network error: Client connection negotiation failed: client connection to 127.24.71.193:46743: connect: Connection refused (error 111)
I20260808 10:02:03.935317 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 23385
I20260808 10:02:03.948354 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 22838
2026-08-08T10:02:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (925 ms)
[----------] 6 tests from EncryptionPolicyTest (9386 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:04 dist-test-slave-gw5c krb5kdc[23630](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:04 dist-test-slave-gw5c krb5kdc[23630](info): set up 2 sockets
Aug 08 10:02:04 dist-test-slave-gw5c krb5kdc[23630](info): commencing operation
krb5kdc: starting...
W20260808 10:02:05.221206 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:05 dist-test-slave-gw5c krb5kdc[23630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 10:02:05.350823 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33523
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33523
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:05.440214 23646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:05.440444 23646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:05.440470 23646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:05.441612 23646 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:05.441658 23646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:05.441672 23646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:05.441685 23646 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:05.441699 23646 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:05.443224 23646 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33523
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:05.443532 23646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:05.443740 23646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:05.448719 23655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:05.448707 23658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:05.448707 23660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:05.449051 23646 server_base.cc:1034] running on GCE node
I20260808 10:02:05.449317 23646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:05.449617 23646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:05.450788 23646 hybrid_clock.cc:648] HybridClock initialized: now 1786183325450770 us; error 50 us; skew 500 ppm
Aug 08 10:02:05 dist-test-slave-gw5c krb5kdc[23630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183325, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:05.453416 23646 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 10:02:05.453887 23646 webserver.cc:460] Webserver started at http://127.0.0.1:42601/ using document root <none> and password file <none>
I20260808 10:02:05.454135 23646 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:05.454206 23646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:05.454358 23646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:05.455549 23646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "58125cef150b41f3a5cc9eb838222b78"
format_stamp: "Formatted at 2026-08-08 10:02:05 on dist-test-slave-gw5c"
server_key: "a5b96d53c46fbe8bc63e64a6fe5d4625"
server_key_iv: "3c048b8c1eca51042378f37fc3f07cef"
server_key_version: "encryptionkey@0"
I20260808 10:02:05.455955 23646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "58125cef150b41f3a5cc9eb838222b78"
format_stamp: "Formatted at 2026-08-08 10:02:05 on dist-test-slave-gw5c"
server_key: "a5b96d53c46fbe8bc63e64a6fe5d4625"
server_key_iv: "3c048b8c1eca51042378f37fc3f07cef"
server_key_version: "encryptionkey@0"
I20260808 10:02:05.457413 23646 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:05.458151 23667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:05.458328 23646 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:02:05.458437 23646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "58125cef150b41f3a5cc9eb838222b78"
format_stamp: "Formatted at 2026-08-08 10:02:05 on dist-test-slave-gw5c"
server_key: "a5b96d53c46fbe8bc63e64a6fe5d4625"
server_key_iv: "3c048b8c1eca51042378f37fc3f07cef"
server_key_version: "encryptionkey@0"
I20260808 10:02:05.458513 23646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:05.465704 23646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:05.467573 23646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:05.467727 23646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:05.471805 23646 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33523
I20260808 10:02:05.471839 23741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33523 every 8 connection(s)
I20260808 10:02:05.472229 23646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:05.473232 23742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:05.475701 23742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78: Bootstrap starting.
I20260808 10:02:05.476289 23742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:05.476531 23742 log.cc:824] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:05.476639 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 23646
I20260808 10:02:05.476769 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:05.476967 24863 external_mini_cluster.cc:1428] Setting key 8f934779ee4594a1ec144e8cd4776c0f
I20260808 10:02:05.477442 23742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78: No bootstrap required, opened a new log
I20260808 10:02:05.479769 23742 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58125cef150b41f3a5cc9eb838222b78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33523 } }
I20260808 10:02:05.479965 23742 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:05.480008 23742 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58125cef150b41f3a5cc9eb838222b78, State: Initialized, Role: FOLLOWER
I20260808 10:02:05.480180 23742 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58125cef150b41f3a5cc9eb838222b78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33523 } }
I20260808 10:02:05.480261 23742 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:05.480293 23742 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:05.480340 23742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:05.481057 23742 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58125cef150b41f3a5cc9eb838222b78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33523 } }
I20260808 10:02:05.481165 23742 leader_election.cc:302] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58125cef150b41f3a5cc9eb838222b78; no voters:
I20260808 10:02:05.481333 23742 leader_election.cc:288] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:05.481391 23747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:05.481570 23747 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [term 1 LEADER]: Becoming Leader. State: Replica: 58125cef150b41f3a5cc9eb838222b78, State: Running, Role: LEADER
I20260808 10:02:05.481591 23742 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:05.481657 23747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58125cef150b41f3a5cc9eb838222b78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33523 } }
I20260808 10:02:05.481958 23747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58125cef150b41f3a5cc9eb838222b78. Latest consensus state: current_term: 1 leader_uuid: "58125cef150b41f3a5cc9eb838222b78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58125cef150b41f3a5cc9eb838222b78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33523 } } }
I20260808 10:02:05.482057 23747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:05.481971 23749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58125cef150b41f3a5cc9eb838222b78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58125cef150b41f3a5cc9eb838222b78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33523 } } }
I20260808 10:02:05.482223 23749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:05.482350 23756 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:05.482934 23756 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 10:02:05 dist-test-slave-gw5c krb5kdc[23630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 10:02:05.485913 23756 catalog_manager.cc:1347] Generated new cluster ID: 83355a272aca449eb76f1a8e07de17d8
I20260808 10:02:05.485965 23756 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:05.490250 23746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:05.477566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35725 (local address 127.0.0.1:33523)
0808 10:02:05.477780 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:05.477789 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:05.477822 (+ 33us) server_negotiation.cc:407] Connection header received
0808 10:02:05.478831 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:05.478840 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:05.478906 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:05.479076 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:05.479748 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:05.481459 (+ 1711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:05.482743 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:05.483504 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:05.483640 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:05.486350 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:05.486354 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:05.486355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:05.486369 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:05.488481 (+ 2112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:05.488963 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:05.488967 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:05.488967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:05.489087 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:05.489325 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:05.489326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:05.489326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:05.489658 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:05.489833 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:05.489918 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 10:02:05.490030 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":102,"threads_started":1}
I20260808 10:02:05.491576 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:05.493072 23756 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:05.493584 23756 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:05.498839 23756 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58125cef150b41f3a5cc9eb838222b78: Generated new TSK 0
I20260808 10:02:05.499047 23756 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:05.502897 23746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:05.493129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36671 (local address 127.0.0.1:33523)
0808 10:02:05.493191 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:05.493193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:05.495782 (+ 2589us) server_negotiation.cc:407] Connection header received
0808 10:02:05.495817 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:05.495819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:05.495830 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:05.495902 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:05.496519 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:05.497332 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:05.498335 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:05.498698 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:05.498768 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:05.500170 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:05.500172 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:05.500172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:05.500179 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:05.501704 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:05.502101 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:05.502103 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:05.502103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:05.502169 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:05.502383 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:05.502384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:05.502385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:05.502530 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:05.502632 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:05.502734 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 10:02:05.502802 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 10:02:05.505187 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 23646
W20260808 10:02:05.518702 23627 connection.cc:535] client connection to 127.0.0.1:33523 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33523): Connection reset by peer (error 104)
2026-08-08T10:02:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1559 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:05 dist-test-slave-gw5c krb5kdc[23783](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:05 dist-test-slave-gw5c krb5kdc[23783](info): set up 2 sockets
Aug 08 10:02:05 dist-test-slave-gw5c krb5kdc[23783](info): commencing operation
krb5kdc: starting...
W20260808 10:02:06.791340 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.259s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:06 dist-test-slave-gw5c krb5kdc[23783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 10:02:06.923476 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43913
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:07.017776 23805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:07.018021 23805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:07.018050 23805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:07.019351 23805 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:07.019431 23805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:07.019449 23805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:07.019464 23805 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:07.019477 23805 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:07.021171 23805 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43913
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:07.021416 23805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:07.021627 23805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:07.027149 23813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:07.027215 23818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:07.027511 23805 server_base.cc:1034] running on GCE node
W20260808 10:02:07.027172 23811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:07.027882 23805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:07.028312 23805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:07.029536 23805 hybrid_clock.cc:648] HybridClock initialized: now 1786183327029520 us; error 31 us; skew 500 ppm
Aug 08 10:02:07 dist-test-slave-gw5c krb5kdc[23783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183327, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:07.032814 23805 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 10:02:07.033304 23805 webserver.cc:460] Webserver started at http://127.0.0.1:37059/ using document root <none> and password file <none>
I20260808 10:02:07.033598 23805 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:07.033674 23805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:07.033842 23805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:07.035008 23805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "1d2a34f1ac914c10be5bb5c1995cce93"
format_stamp: "Formatted at 2026-08-08 10:02:07 on dist-test-slave-gw5c"
server_key: "f7c26d76f51c37f9e512ce5c2d70a1f3"
server_key_iv: "2328070770060e30c7fab1dca704386a"
server_key_version: "encryptionkey@0"
I20260808 10:02:07.035470 23805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "1d2a34f1ac914c10be5bb5c1995cce93"
format_stamp: "Formatted at 2026-08-08 10:02:07 on dist-test-slave-gw5c"
server_key: "f7c26d76f51c37f9e512ce5c2d70a1f3"
server_key_iv: "2328070770060e30c7fab1dca704386a"
server_key_version: "encryptionkey@0"
I20260808 10:02:07.037009 23805 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:07.037865 23825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:07.038059 23805 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:07.038156 23805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "1d2a34f1ac914c10be5bb5c1995cce93"
format_stamp: "Formatted at 2026-08-08 10:02:07 on dist-test-slave-gw5c"
server_key: "f7c26d76f51c37f9e512ce5c2d70a1f3"
server_key_iv: "2328070770060e30c7fab1dca704386a"
server_key_version: "encryptionkey@0"
I20260808 10:02:07.038249 23805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:07.057466 23805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:07.059659 23805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:07.059849 23805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:07.064061 23805 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43913
I20260808 10:02:07.064143 23903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43913 every 8 connection(s)
I20260808 10:02:07.064517 23805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:07.065487 23904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:07.068073 23904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93: Bootstrap starting.
I20260808 10:02:07.068754 23904 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:07.069085 23904 log.cc:824] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:07.069996 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 23805
I20260808 10:02:07.070019 23904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93: No bootstrap required, opened a new log
I20260808 10:02:07.070144 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:07.070441 24863 external_mini_cluster.cc:1428] Setting key dde8475cdf361dd3cf38e476075a8bd9
I20260808 10:02:07.072407 23904 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2a34f1ac914c10be5bb5c1995cce93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43913 } }
I20260808 10:02:07.072563 23904 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:07.072587 23904 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d2a34f1ac914c10be5bb5c1995cce93, State: Initialized, Role: FOLLOWER
I20260808 10:02:07.072786 23904 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2a34f1ac914c10be5bb5c1995cce93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43913 } }
I20260808 10:02:07.072896 23904 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:07.072943 23904 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:07.073019 23904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:07.073697 23904 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2a34f1ac914c10be5bb5c1995cce93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43913 } }
I20260808 10:02:07.073804 23904 leader_election.cc:302] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d2a34f1ac914c10be5bb5c1995cce93; no voters:
I20260808 10:02:07.074007 23904 leader_election.cc:288] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:07.074033 23910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:07.074155 23910 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [term 1 LEADER]: Becoming Leader. State: Replica: 1d2a34f1ac914c10be5bb5c1995cce93, State: Running, Role: LEADER
I20260808 10:02:07.074258 23910 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2a34f1ac914c10be5bb5c1995cce93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43913 } }
I20260808 10:02:07.074342 23904 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:07.074620 23911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d2a34f1ac914c10be5bb5c1995cce93. Latest consensus state: current_term: 1 leader_uuid: "1d2a34f1ac914c10be5bb5c1995cce93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2a34f1ac914c10be5bb5c1995cce93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43913 } } }
I20260808 10:02:07.074882 23911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:07.074800 23912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d2a34f1ac914c10be5bb5c1995cce93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2a34f1ac914c10be5bb5c1995cce93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43913 } } }
I20260808 10:02:07.075176 23912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:07.075418 23923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:07.075994 23923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:07.077806 23923 catalog_manager.cc:1347] Generated new cluster ID: f7c2b87ec84b4a3b996e4d23c2972f6f
I20260808 10:02:07.077873 23923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:07.081722 23909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:07.071090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45415 (local address 127.0.0.1:43913)
0808 10:02:07.071334 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:07.071343 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:07.071372 (+ 29us) server_negotiation.cc:407] Connection header received
0808 10:02:07.072400 (+ 1028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:07.072409 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:07.072477 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:07.072657 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:07.072988 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:07.074654 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:07.079561 (+ 4907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:07.080021 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:07.080163 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:07.081001 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:07.081006 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:07.081006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:07.081203 (+ 197us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:07.081237 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:07.081249 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:07.081366 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:07.081446 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 10:02:07.081480 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":118,"threads_started":1}
I20260808 10:02:07.083158 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:07.088085 23909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:07.084784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51671 (local address 127.0.0.1:43913)
0808 10:02:07.084828 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:07.084830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:07.084966 (+ 136us) server_negotiation.cc:407] Connection header received
0808 10:02:07.085047 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:07.085048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:07.085071 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:07.085128 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:07.085276 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:07.085803 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:07.086596 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:07.086865 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:07.086948 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:07.087775 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:07.087777 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:07.087777 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:07.087783 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:07.087799 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:07.087804 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:07.087869 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:07.087955 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 10:02:07.087968 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":22}
I20260808 10:02:07.101374 23923 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:07.102213 23923 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:07.115823 23923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d2a34f1ac914c10be5bb5c1995cce93: Generated new TSK 0
I20260808 10:02:07.116086 23923 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:07.123376 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 23805
W20260808 10:02:07.140512 23779 connection.cc:535] client connection to 127.0.0.1:43913 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43913): Connection reset by peer (error 104)
2026-08-08T10:02:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1621 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:07 dist-test-slave-gw5c krb5kdc[23948](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:07 dist-test-slave-gw5c krb5kdc[23948](info): set up 2 sockets
Aug 08 10:02:07 dist-test-slave-gw5c krb5kdc[23948](info): commencing operation
krb5kdc: starting...
W20260808 10:02:08.396733 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:08 dist-test-slave-gw5c krb5kdc[23948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183328, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 10:02:08.534148 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33137
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33137
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:08.617427 23968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:08.617666 23968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:08.617690 23968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:08.618804 23968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:08.618841 23968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:08.618855 23968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:08.618868 23968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:08.618880 23968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:08.620396 23968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33137
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:08.620608 23968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:08.620793 23968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:08.625789 23977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:08.625906 23968 server_base.cc:1034] running on GCE node
W20260808 10:02:08.625803 23981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:08.625803 23978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:08.626243 23968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:08.626518 23968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:08.627653 23968 hybrid_clock.cc:648] HybridClock initialized: now 1786183328627628 us; error 38 us; skew 500 ppm
Aug 08 10:02:08 dist-test-slave-gw5c krb5kdc[23948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183328, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:08.630218 23968 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 10:02:08.630731 23968 webserver.cc:460] Webserver started at http://127.0.0.1:36803/ using document root <none> and password file <none>
I20260808 10:02:08.630990 23968 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:08.631060 23968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:08.631210 23968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:08.632367 23968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "8f66768102c64ec9a9960b7d4d0a4fb5"
format_stamp: "Formatted at 2026-08-08 10:02:08 on dist-test-slave-gw5c"
server_key: "3c2d5eb09484952ad125fcf181c9564c"
server_key_iv: "7f887818420fb41d607308e19caaf484"
server_key_version: "encryptionkey@0"
I20260808 10:02:08.632781 23968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "8f66768102c64ec9a9960b7d4d0a4fb5"
format_stamp: "Formatted at 2026-08-08 10:02:08 on dist-test-slave-gw5c"
server_key: "3c2d5eb09484952ad125fcf181c9564c"
server_key_iv: "7f887818420fb41d607308e19caaf484"
server_key_version: "encryptionkey@0"
I20260808 10:02:08.634236 23968 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:02:08.635072 23995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:08.635269 23968 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:08.635378 23968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "8f66768102c64ec9a9960b7d4d0a4fb5"
format_stamp: "Formatted at 2026-08-08 10:02:08 on dist-test-slave-gw5c"
server_key: "3c2d5eb09484952ad125fcf181c9564c"
server_key_iv: "7f887818420fb41d607308e19caaf484"
server_key_version: "encryptionkey@0"
I20260808 10:02:08.635519 23968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:08.638963 23968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:08.641255 23968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:08.641429 23968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:08.645887 23968 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33137
I20260808 10:02:08.645924 24072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33137 every 8 connection(s)
I20260808 10:02:08.646286 23968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:08.647322 24073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:08.649777 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 23968
I20260808 10:02:08.649911 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:08.649909 24073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5: Bootstrap starting.
I20260808 10:02:08.650105 24863 external_mini_cluster.cc:1428] Setting key 1607749abeaebf00fb0fd6dbabe37c66
I20260808 10:02:08.650650 24073 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:08.651008 24073 log.cc:824] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:08.651787 24073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5: No bootstrap required, opened a new log
I20260808 10:02:08.652978 24078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:08.650683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54263 (local address 127.0.0.1:33137)
0808 10:02:08.650902 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:08.650914 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:08.650957 (+ 43us) server_negotiation.cc:407] Connection header received
0808 10:02:08.651635 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:08.651643 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:08.651672 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:08.651830 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:08.652551 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:08.652555 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:08.652555 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:08.652560 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:08.652606 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:08.652617 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:08.652723 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:08.652758 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 10:02:08.652799 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":98,"threads_started":1}
I20260808 10:02:08.654012 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:08.654435 24073 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f66768102c64ec9a9960b7d4d0a4fb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33137 } }
I20260808 10:02:08.654603 24073 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:08.654649 24073 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f66768102c64ec9a9960b7d4d0a4fb5, State: Initialized, Role: FOLLOWER
I20260808 10:02:08.654774 24073 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f66768102c64ec9a9960b7d4d0a4fb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33137 } }
I20260808 10:02:08.654886 24073 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:08.654932 24073 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:08.654991 24073 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:08.655891 24073 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f66768102c64ec9a9960b7d4d0a4fb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33137 } }
I20260808 10:02:08.656013 24073 leader_election.cc:302] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f66768102c64ec9a9960b7d4d0a4fb5; no voters:
I20260808 10:02:08.656177 24073 leader_election.cc:288] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:08.656255 24086 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:08.656476 24073 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:08.656596 24086 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 8f66768102c64ec9a9960b7d4d0a4fb5, State: Running, Role: LEADER
I20260808 10:02:08.656728 24086 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f66768102c64ec9a9960b7d4d0a4fb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33137 } }
I20260808 10:02:08.656874 24078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:08.655689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34955 (local address 127.0.0.1:33137)
0808 10:02:08.655761 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:08.655763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:08.655776 (+ 13us) server_negotiation.cc:407] Connection header received
0808 10:02:08.655794 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:08.655794 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:08.655798 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:08.655863 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:08.656489 (+ 626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:08.656491 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:08.656491 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:08.656496 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:08.656512 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:08.656517 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:08.656571 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:08.656805 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 10:02:08.656819 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 10:02:08.657096 24086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f66768102c64ec9a9960b7d4d0a4fb5. Latest consensus state: current_term: 1 leader_uuid: "8f66768102c64ec9a9960b7d4d0a4fb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f66768102c64ec9a9960b7d4d0a4fb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33137 } } }
I20260808 10:02:08.657181 24086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:08.657110 24087 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f66768102c64ec9a9960b7d4d0a4fb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f66768102c64ec9a9960b7d4d0a4fb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33137 } } }
I20260808 10:02:08.657356 24087 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:08.657418 24097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:08.657965 24097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:08.659789 24097 catalog_manager.cc:1347] Generated new cluster ID: 520eaddbcab340ce97a70300b55bbc89
I20260808 10:02:08.659853 24097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:08.677232 24097 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:08.677454 24097 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:08.681915 24097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f66768102c64ec9a9960b7d4d0a4fb5: Generated new TSK 0
I20260808 10:02:08.682133 24097 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:08.692878 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 23968
2026-08-08T10:02:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1569 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:08 dist-test-slave-gw5c krb5kdc[24114](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:08 dist-test-slave-gw5c krb5kdc[24114](info): set up 2 sockets
Aug 08 10:02:08 dist-test-slave-gw5c krb5kdc[24114](info): commencing operation
krb5kdc: starting...
W20260808 10:02:09.937889 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.214s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:10 dist-test-slave-gw5c krb5kdc[24114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 10:02:10.066927 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36977
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:10.150524 24134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:10.150739 24134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:10.150763 24134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:10.151998 24134 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:10.152045 24134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:10.152060 24134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:10.152073 24134 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:10.152086 24134 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:10.153592 24134 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:10.153859 24134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:10.154101 24134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 10:02:10.159199 24134 server_base.cc:1034] running on GCE node
W20260808 10:02:10.159227 24144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:10.159260 24140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:10.159416 24146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:10.159691 24134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:10.159994 24134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:10.161135 24134 hybrid_clock.cc:648] HybridClock initialized: now 1786183330161114 us; error 44 us; skew 500 ppm
Aug 08 10:02:10 dist-test-slave-gw5c krb5kdc[24114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183330, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:10.167658 24134 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 10:02:10.168102 24134 webserver.cc:460] Webserver started at http://127.0.0.1:34361/ using document root <none> and password file <none>
I20260808 10:02:10.168303 24134 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:10.168349 24134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:10.168449 24134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:10.169499 24134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "6ffe63efc7e14679a95efe82e996aa33"
format_stamp: "Formatted at 2026-08-08 10:02:10 on dist-test-slave-gw5c"
server_key: "656e45def43d01feab349965340d0aa9"
server_key_iv: "2f3ca14ddf723dd297cc2a7441d94f3a"
server_key_version: "encryptionkey@0"
I20260808 10:02:10.169808 24134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "6ffe63efc7e14679a95efe82e996aa33"
format_stamp: "Formatted at 2026-08-08 10:02:10 on dist-test-slave-gw5c"
server_key: "656e45def43d01feab349965340d0aa9"
server_key_iv: "2f3ca14ddf723dd297cc2a7441d94f3a"
server_key_version: "encryptionkey@0"
I20260808 10:02:10.171110 24134 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 10:02:10.171909 24157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:10.172135 24134 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 10:02:10.172236 24134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "6ffe63efc7e14679a95efe82e996aa33"
format_stamp: "Formatted at 2026-08-08 10:02:10 on dist-test-slave-gw5c"
server_key: "656e45def43d01feab349965340d0aa9"
server_key_iv: "2f3ca14ddf723dd297cc2a7441d94f3a"
server_key_version: "encryptionkey@0"
I20260808 10:02:10.172315 24134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:10.190122 24134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:10.192737 24134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:10.192910 24134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:10.197162 24134 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36977
I20260808 10:02:10.197214 24234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36977 every 8 connection(s)
I20260808 10:02:10.197610 24134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:10.198530 24236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:10.200919 24236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33: Bootstrap starting.
I20260808 10:02:10.201543 24236 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:10.201833 24236 log.cc:824] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:10.202623 24236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33: No bootstrap required, opened a new log
I20260808 10:02:10.202646 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 24134
I20260808 10:02:10.202777 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:10.202965 24863 external_mini_cluster.cc:1428] Setting key 4f446ff4de172bd4811eb34f1e272083
I20260808 10:02:10.205212 24236 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ffe63efc7e14679a95efe82e996aa33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36977 } }
I20260808 10:02:10.205346 24236 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:10.205368 24236 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ffe63efc7e14679a95efe82e996aa33, State: Initialized, Role: FOLLOWER
I20260808 10:02:10.205502 24236 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ffe63efc7e14679a95efe82e996aa33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36977 } }
I20260808 10:02:10.205574 24236 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:10.205595 24236 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:10.205662 24236 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:10.206238 24236 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ffe63efc7e14679a95efe82e996aa33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36977 } }
I20260808 10:02:10.206324 24236 leader_election.cc:302] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ffe63efc7e14679a95efe82e996aa33; no voters:
I20260808 10:02:10.206553 24236 leader_election.cc:288] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:10.206579 24246 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:10.206772 24246 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [term 1 LEADER]: Becoming Leader. State: Replica: 6ffe63efc7e14679a95efe82e996aa33, State: Running, Role: LEADER
I20260808 10:02:10.206918 24246 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ffe63efc7e14679a95efe82e996aa33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36977 } }
I20260808 10:02:10.206909 24236 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:10.207311 24248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ffe63efc7e14679a95efe82e996aa33. Latest consensus state: current_term: 1 leader_uuid: "6ffe63efc7e14679a95efe82e996aa33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ffe63efc7e14679a95efe82e996aa33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36977 } } }
I20260808 10:02:10.207598 24248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:10.207522 24247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ffe63efc7e14679a95efe82e996aa33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ffe63efc7e14679a95efe82e996aa33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36977 } } }
I20260808 10:02:10.207877 24247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:10.208012 24252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:10.208557 24252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 10:02:10 dist-test-slave-gw5c krb5kdc[24114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 10:02:10.210902 24252 catalog_manager.cc:1347] Generated new cluster ID: ee95ef6d18244a728828d0f58962f2c9
I20260808 10:02:10.210958 24252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:10.215226 24244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:10.203509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47295 (local address 127.0.0.1:36977)
0808 10:02:10.203691 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:10.203699 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:10.203725 (+ 26us) server_negotiation.cc:407] Connection header received
0808 10:02:10.204131 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:10.204138 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:10.204183 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:10.204298 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:10.205103 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:10.206473 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:10.207528 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:10.208191 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:10.208281 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:10.211335 (+ 3054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:10.211339 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:10.211339 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:10.211352 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:10.213444 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:10.213859 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:10.213862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:10.213863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:10.213976 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:10.214170 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:10.214171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:10.214171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:10.214511 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:10.214684 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:10.214769 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 10:02:10.214915 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":95,"threads_started":1}
I20260808 10:02:10.216671 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:10.220826 24252 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:10.221524 24252 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:10.225837 24244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:10.218128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54081 (local address 127.0.0.1:36977)
0808 10:02:10.218166 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:10.218168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:10.218454 (+ 286us) server_negotiation.cc:407] Connection header received
0808 10:02:10.218486 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:10.218488 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:10.218501 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:10.218571 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:10.219209 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:10.220008 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:10.220962 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:10.221256 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:10.221295 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:10.222831 (+ 1536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:10.222832 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:10.222832 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:10.222839 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:10.224656 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:10.225023 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:10.225024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:10.225025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:10.225097 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:10.225293 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:10.225294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:10.225294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:10.225424 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:10.225525 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:10.225629 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 10:02:10.225719 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 10:02:10.227262 24252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ffe63efc7e14679a95efe82e996aa33: Generated new TSK 0
I20260808 10:02:10.227460 24252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:10.231815 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 24134
2026-08-08T10:02:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1537 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:10 dist-test-slave-gw5c krb5kdc[24280](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:10 dist-test-slave-gw5c krb5kdc[24280](info): set up 2 sockets
Aug 08 10:02:10 dist-test-slave-gw5c krb5kdc[24280](info): commencing operation
krb5kdc: starting...
W20260808 10:02:11.490381 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:11 dist-test-slave-gw5c krb5kdc[24280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 10:02:11.619457 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33953
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33953
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:11.705260 24296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:11.705494 24296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:11.705520 24296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:11.706719 24296 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:11.706763 24296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:11.706776 24296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:11.706789 24296 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:11.706801 24296 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:11.708361 24296 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:11.708585 24296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:11.708783 24296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:11.714028 24308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:11.714044 24306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:11.714044 24303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:11.714497 24296 server_base.cc:1034] running on GCE node
I20260808 10:02:11.714804 24296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:11.715140 24296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:11.716331 24296 hybrid_clock.cc:648] HybridClock initialized: now 1786183331716309 us; error 40 us; skew 500 ppm
Aug 08 10:02:11 dist-test-slave-gw5c krb5kdc[24280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183331, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:11.718986 24296 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 10:02:11.719568 24296 webserver.cc:460] Webserver started at http://127.0.0.1:42701/ using document root <none> and password file <none>
I20260808 10:02:11.719828 24296 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:11.719904 24296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:11.720065 24296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:11.721163 24296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "8c78665f07894f1da2e36bd174971d54"
format_stamp: "Formatted at 2026-08-08 10:02:11 on dist-test-slave-gw5c"
server_key: "f38f87969b5bd38c711651d2a1fd36b3"
server_key_iv: "a2eac499302a362ed1e8585a3bde8318"
server_key_version: "encryptionkey@0"
I20260808 10:02:11.721580 24296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "8c78665f07894f1da2e36bd174971d54"
format_stamp: "Formatted at 2026-08-08 10:02:11 on dist-test-slave-gw5c"
server_key: "f38f87969b5bd38c711651d2a1fd36b3"
server_key_iv: "a2eac499302a362ed1e8585a3bde8318"
server_key_version: "encryptionkey@0"
I20260808 10:02:11.722971 24296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 10:02:11.723798 24321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:11.723982 24296 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:11.724093 24296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "8c78665f07894f1da2e36bd174971d54"
format_stamp: "Formatted at 2026-08-08 10:02:11 on dist-test-slave-gw5c"
server_key: "f38f87969b5bd38c711651d2a1fd36b3"
server_key_iv: "a2eac499302a362ed1e8585a3bde8318"
server_key_version: "encryptionkey@0"
I20260808 10:02:11.724174 24296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:11.755635 24296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:11.757668 24296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:11.757786 24296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:11.762243 24296 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33953
I20260808 10:02:11.762315 24397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33953 every 8 connection(s)
I20260808 10:02:11.762696 24296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:11.763638 24399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:11.766026 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 24296
I20260808 10:02:11.766137 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:11.766134 24399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54: Bootstrap starting.
I20260808 10:02:11.766326 24863 external_mini_cluster.cc:1428] Setting key d9a5adbcb171f9a65b3c7bf88bd71c99
I20260808 10:02:11.766981 24399 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:11.767345 24399 log.cc:824] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:11.768154 24399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54: No bootstrap required, opened a new log
I20260808 10:02:11.770032 24399 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c78665f07894f1da2e36bd174971d54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33953 } }
I20260808 10:02:11.770200 24399 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:11.770247 24399 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c78665f07894f1da2e36bd174971d54, State: Initialized, Role: FOLLOWER
I20260808 10:02:11.770392 24399 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c78665f07894f1da2e36bd174971d54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33953 } }
I20260808 10:02:11.770481 24399 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:11.770529 24399 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:11.770581 24399 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:11.771167 24399 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c78665f07894f1da2e36bd174971d54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33953 } }
I20260808 10:02:11.771293 24399 leader_election.cc:302] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c78665f07894f1da2e36bd174971d54; no voters:
I20260808 10:02:11.771486 24399 leader_election.cc:288] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:11.771513 24409 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:11.771631 24409 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [term 1 LEADER]: Becoming Leader. State: Replica: 8c78665f07894f1da2e36bd174971d54, State: Running, Role: LEADER
I20260808 10:02:11.771783 24399 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:11.771772 24409 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c78665f07894f1da2e36bd174971d54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33953 } }
I20260808 10:02:11.772217 24403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:11.766930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56621 (local address 127.0.0.1:33953)
0808 10:02:11.767164 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:11.767175 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:11.767207 (+ 32us) server_negotiation.cc:407] Connection header received
0808 10:02:11.767811 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:11.767820 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:11.767898 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:11.768061 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:11.768299 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:11.769197 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:11.769989 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:11.770529 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:11.770649 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:11.771408 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:11.771413 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:11.771413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:11.771654 (+ 241us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:11.771698 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:11.771712 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:11.771949 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:11.771980 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 10:02:11.772043 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":86,"threads_started":1}
I20260808 10:02:11.772393 24411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c78665f07894f1da2e36bd174971d54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c78665f07894f1da2e36bd174971d54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33953 } } }
I20260808 10:02:11.772502 24412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c78665f07894f1da2e36bd174971d54. Latest consensus state: current_term: 1 leader_uuid: "8c78665f07894f1da2e36bd174971d54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c78665f07894f1da2e36bd174971d54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33953 } } }
I20260808 10:02:11.772601 24411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:11.772850 24412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:11.773026 24427 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:11.773106 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:11.773813 24427 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:11.775514 24427 catalog_manager.cc:1347] Generated new cluster ID: c94c25fdcc234736a16deb41b38452cd
I20260808 10:02:11.775569 24427 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:11.780879 24427 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:11.781582 24427 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:11.783478 24403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:11.774747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46437 (local address 127.0.0.1:33953)
0808 10:02:11.774782 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:11.774783 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:11.774889 (+ 106us) server_negotiation.cc:407] Connection header received
0808 10:02:11.774954 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:11.774955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:11.774967 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:11.775189 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:11.775369 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:11.780842 (+ 5473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:11.781913 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:11.782206 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:11.782254 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:11.783042 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:11.783044 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:11.783044 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:11.783050 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:11.783064 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:11.783069 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:11.783105 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:11.783321 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 10:02:11.783358 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 10:02:11.788755 24427 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c78665f07894f1da2e36bd174971d54: Generated new TSK 0
I20260808 10:02:11.789036 24427 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:11.798631 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 24296
2026-08-08T10:02:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1567 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:11 dist-test-slave-gw5c krb5kdc[24449](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:11 dist-test-slave-gw5c krb5kdc[24449](info): set up 2 sockets
Aug 08 10:02:11 dist-test-slave-gw5c krb5kdc[24449](info): commencing operation
krb5kdc: starting...
W20260808 10:02:13.045709 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:13 dist-test-slave-gw5c krb5kdc[24449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 10:02:13.182843 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39859
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:13.267813 24467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:13.268092 24467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:13.268139 24467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:13.269338 24467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:13.269424 24467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:13.269449 24467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:13.269474 24467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:13.269502 24467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:13.271045 24467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:13.271361 24467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:13.271652 24467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:13.276688 24480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:13.276688 24475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:13.276700 24474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:13.277027 24467 server_base.cc:1034] running on GCE node
I20260808 10:02:13.277354 24467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:13.277671 24467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:13.278842 24467 hybrid_clock.cc:648] HybridClock initialized: now 1786183333278828 us; error 54 us; skew 500 ppm
Aug 08 10:02:13 dist-test-slave-gw5c krb5kdc[24449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183333, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:13.281582 24467 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 10:02:13.282094 24467 webserver.cc:460] Webserver started at http://127.0.0.1:45303/ using document root <none> and password file <none>
I20260808 10:02:13.282299 24467 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:13.282342 24467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:13.282441 24467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:13.283602 24467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "b71ea970cf204dbdb6537dcd60c3768e"
format_stamp: "Formatted at 2026-08-08 10:02:13 on dist-test-slave-gw5c"
server_key: "dd9c6257108fc2e4bdaf2ee0416c1893"
server_key_iv: "2669f6444029f01af5b6688c073e4853"
server_key_version: "encryptionkey@0"
I20260808 10:02:13.283931 24467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "b71ea970cf204dbdb6537dcd60c3768e"
format_stamp: "Formatted at 2026-08-08 10:02:13 on dist-test-slave-gw5c"
server_key: "dd9c6257108fc2e4bdaf2ee0416c1893"
server_key_iv: "2669f6444029f01af5b6688c073e4853"
server_key_version: "encryptionkey@0"
I20260808 10:02:13.285277 24467 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:02:13.286015 24489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:13.286231 24467 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:13.286332 24467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "b71ea970cf204dbdb6537dcd60c3768e"
format_stamp: "Formatted at 2026-08-08 10:02:13 on dist-test-slave-gw5c"
server_key: "dd9c6257108fc2e4bdaf2ee0416c1893"
server_key_iv: "2669f6444029f01af5b6688c073e4853"
server_key_version: "encryptionkey@0"
I20260808 10:02:13.286428 24467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:13.289956 24467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:13.292140 24467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:13.292301 24467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:13.296444 24467 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39859
I20260808 10:02:13.296504 24565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39859 every 8 connection(s)
I20260808 10:02:13.296839 24467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:13.297921 24568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:13.298782 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 24467
I20260808 10:02:13.298914 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:13.299127 24863 external_mini_cluster.cc:1428] Setting key f7b6487d3aa5e8ce978504ca6b4632b9
I20260808 10:02:13.301509 24568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e: Bootstrap starting.
I20260808 10:02:13.301899 24572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:13.299740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60673 (local address 127.0.0.1:39859)
0808 10:02:13.299927 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:13.299936 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:13.299969 (+ 33us) server_negotiation.cc:407] Connection header received
0808 10:02:13.300575 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:13.300585 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:13.300623 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:13.300792 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:13.301453 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:13.301457 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:13.301458 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:13.301462 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:13.301508 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:13.301522 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:13.301602 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:13.301665 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 10:02:13.301707 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":79,"threads_started":1}
I20260808 10:02:13.302310 24568 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:13.302635 24568 log.cc:824] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:13.303050 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:13.303511 24568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e: No bootstrap required, opened a new log
I20260808 10:02:13.305646 24572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:13.304636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50029 (local address 127.0.0.1:39859)
0808 10:02:13.304680 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:13.304681 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:13.304757 (+ 76us) server_negotiation.cc:407] Connection header received
0808 10:02:13.304833 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:13.304834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:13.304838 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:13.304897 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:13.305440 (+ 543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:13.305441 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:13.305441 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:13.305444 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:13.305455 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:13.305459 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:13.305499 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:13.305561 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 10:02:13.305573 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 10:02:13.305930 24568 raft_consensus.cc:348] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71ea970cf204dbdb6537dcd60c3768e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39859 } }
I20260808 10:02:13.306128 24568 raft_consensus.cc:374] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:13.306181 24568 raft_consensus.cc:729] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71ea970cf204dbdb6537dcd60c3768e, State: Initialized, Role: FOLLOWER
I20260808 10:02:13.306313 24568 consensus_queue.cc:260] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71ea970cf204dbdb6537dcd60c3768e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39859 } }
I20260808 10:02:13.306396 24568 raft_consensus.cc:388] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:13.306460 24568 raft_consensus.cc:482] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:13.306511 24568 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:13.307112 24568 raft_consensus.cc:504] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71ea970cf204dbdb6537dcd60c3768e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39859 } }
I20260808 10:02:13.307230 24568 leader_election.cc:302] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b71ea970cf204dbdb6537dcd60c3768e; no voters:
I20260808 10:02:13.307442 24568 leader_election.cc:288] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:13.307526 24581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:13.307698 24581 raft_consensus.cc:686] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [term 1 LEADER]: Becoming Leader. State: Replica: b71ea970cf204dbdb6537dcd60c3768e, State: Running, Role: LEADER
I20260808 10:02:13.307716 24568 sys_catalog.cc:564] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:13.307852 24581 consensus_queue.cc:237] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71ea970cf204dbdb6537dcd60c3768e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39859 } }
I20260808 10:02:13.308303 24582 sys_catalog.cc:455] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b71ea970cf204dbdb6537dcd60c3768e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71ea970cf204dbdb6537dcd60c3768e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39859 } } }
I20260808 10:02:13.308331 24583 sys_catalog.cc:455] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b71ea970cf204dbdb6537dcd60c3768e. Latest consensus state: current_term: 1 leader_uuid: "b71ea970cf204dbdb6537dcd60c3768e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71ea970cf204dbdb6537dcd60c3768e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39859 } } }
I20260808 10:02:13.308483 24582 sys_catalog.cc:458] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:13.308497 24583 sys_catalog.cc:458] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:13.308985 24591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:13.309413 24591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:13.310994 24591 catalog_manager.cc:1347] Generated new cluster ID: 345b88d5f65945e78f2ca65e4716c7a1
I20260808 10:02:13.311050 24591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:13.330932 24591 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:13.331144 24591 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:13.335314 24591 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b71ea970cf204dbdb6537dcd60c3768e: Generated new TSK 0
I20260808 10:02:13.335580 24591 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:13.340293 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 24467
2026-08-08T10:02:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1552 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:13 dist-test-slave-gw5c krb5kdc[24613](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:13 dist-test-slave-gw5c krb5kdc[24613](info): set up 2 sockets
Aug 08 10:02:13 dist-test-slave-gw5c krb5kdc[24613](info): commencing operation
krb5kdc: starting...
W20260808 10:02:14.622239 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:14 dist-test-slave-gw5c krb5kdc[24613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 10:02:14.753783 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36221
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:14.837355 24634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:14.837620 24634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:14.837661 24634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:14.838848 24634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:14.838915 24634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:14.838941 24634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:14.838994 24634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:14.839035 24634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:14.840631 24634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:14.840919 24634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:14.841161 24634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:14.846138 24640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:14.846170 24641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:14.846144 24646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:14.846465 24634 server_base.cc:1034] running on GCE node
I20260808 10:02:14.846732 24634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:14.847070 24634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:14.848241 24634 hybrid_clock.cc:648] HybridClock initialized: now 1786183334848234 us; error 47 us; skew 500 ppm
Aug 08 10:02:14 dist-test-slave-gw5c krb5kdc[24613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183334, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:14.850773 24634 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 10:02:14.851227 24634 webserver.cc:460] Webserver started at http://127.0.0.1:44779/ using document root <none> and password file <none>
I20260808 10:02:14.851536 24634 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:14.851620 24634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:14.851786 24634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:14.852874 24634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "b20394126a3846eda1b34cf9d7fa24ca"
format_stamp: "Formatted at 2026-08-08 10:02:14 on dist-test-slave-gw5c"
server_key: "f3c565eb1241bffea2c08438cfbea8bd"
server_key_iv: "a84b1014fd22a0e4a5c9928360c6ecf9"
server_key_version: "encryptionkey@0"
I20260808 10:02:14.853276 24634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "b20394126a3846eda1b34cf9d7fa24ca"
format_stamp: "Formatted at 2026-08-08 10:02:14 on dist-test-slave-gw5c"
server_key: "f3c565eb1241bffea2c08438cfbea8bd"
server_key_iv: "a84b1014fd22a0e4a5c9928360c6ecf9"
server_key_version: "encryptionkey@0"
I20260808 10:02:14.854650 24634 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 10:02:14.855430 24658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:14.855613 24634 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 10:02:14.855719 24634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "b20394126a3846eda1b34cf9d7fa24ca"
format_stamp: "Formatted at 2026-08-08 10:02:14 on dist-test-slave-gw5c"
server_key: "f3c565eb1241bffea2c08438cfbea8bd"
server_key_iv: "a84b1014fd22a0e4a5c9928360c6ecf9"
server_key_version: "encryptionkey@0"
I20260808 10:02:14.855806 24634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:14.866271 24634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:14.868702 24634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:14.868870 24634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:14.873138 24634 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36221
I20260808 10:02:14.873172 24737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36221 every 8 connection(s)
I20260808 10:02:14.873539 24634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:14.874454 24738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:14.876806 24738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca: Bootstrap starting.
I20260808 10:02:14.877395 24738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:14.877687 24738 log.cc:824] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:14.878383 24738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca: No bootstrap required, opened a new log
I20260808 10:02:14.879652 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 24634
I20260808 10:02:14.879786 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:14.879984 24863 external_mini_cluster.cc:1428] Setting key d9ef4fc1386b95d488eaae12e5948297
I20260808 10:02:14.880234 24738 raft_consensus.cc:348] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b20394126a3846eda1b34cf9d7fa24ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36221 } }
I20260808 10:02:14.880398 24738 raft_consensus.cc:374] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:14.880435 24738 raft_consensus.cc:729] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b20394126a3846eda1b34cf9d7fa24ca, State: Initialized, Role: FOLLOWER
I20260808 10:02:14.880550 24738 consensus_queue.cc:260] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b20394126a3846eda1b34cf9d7fa24ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36221 } }
I20260808 10:02:14.880686 24738 raft_consensus.cc:388] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:14.880787 24738 raft_consensus.cc:482] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:14.880860 24738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:14.882145 24738 raft_consensus.cc:504] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b20394126a3846eda1b34cf9d7fa24ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36221 } }
I20260808 10:02:14.882238 24738 leader_election.cc:302] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b20394126a3846eda1b34cf9d7fa24ca; no voters:
I20260808 10:02:14.882416 24738 leader_election.cc:288] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:14.882454 24747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:14.882575 24747 raft_consensus.cc:686] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [term 1 LEADER]: Becoming Leader. State: Replica: b20394126a3846eda1b34cf9d7fa24ca, State: Running, Role: LEADER
I20260808 10:02:14.882689 24738 sys_catalog.cc:564] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:14.882712 24747 consensus_queue.cc:237] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b20394126a3846eda1b34cf9d7fa24ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36221 } }
I20260808 10:02:14.883119 24747 sys_catalog.cc:455] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader b20394126a3846eda1b34cf9d7fa24ca. Latest consensus state: current_term: 1 leader_uuid: "b20394126a3846eda1b34cf9d7fa24ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b20394126a3846eda1b34cf9d7fa24ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36221 } } }
I20260808 10:02:14.883128 24749 sys_catalog.cc:455] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b20394126a3846eda1b34cf9d7fa24ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b20394126a3846eda1b34cf9d7fa24ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36221 } } }
I20260808 10:02:14.883296 24747 sys_catalog.cc:458] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:14.883304 24749 sys_catalog.cc:458] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:14.883883 24759 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:14.884413 24759 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:14.886219 24759 catalog_manager.cc:1347] Generated new cluster ID: 50ec531894b342ef8253fa0cb897086f
I20260808 10:02:14.886332 24759 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 10:02:14 dist-test-slave-gw5c krb5kdc[24613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 10:02:14.893260 24746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:14.880621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:34677 (local address 127.0.0.1:36221)
0808 10:02:14.880814 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:14.880821 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:14.880873 (+ 52us) server_negotiation.cc:407] Connection header received
0808 10:02:14.881037 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:14.881042 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:14.881100 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:14.881212 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:14.882074 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:14.883407 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:14.885717 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:14.886340 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:14.886453 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:14.889381 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:14.889385 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:14.889385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:14.889397 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:14.891418 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:14.891922 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:14.891925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:14.891926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:14.892040 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:14.892361 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:14.892362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:14.892362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:14.892650 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:14.892815 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:14.892957 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 10:02:14.893061 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":91,"threads_started":1}
I20260808 10:02:14.894228 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:14.904352 24759 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:14.905064 24759 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:14.907598 24746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:14.899697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:50143 (local address 127.0.0.1:36221)
0808 10:02:14.899743 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:14.899745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:14.899993 (+ 248us) server_negotiation.cc:407] Connection header received
0808 10:02:14.900025 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:14.900026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:14.900037 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:14.900104 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:14.900819 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:14.901575 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:14.902631 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:14.902975 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:14.903044 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:14.904617 (+ 1573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:14.904618 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:14.904618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:14.904625 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:14.906298 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:14.906747 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:14.906748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:14.906748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:14.906811 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:14.907049 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:14.907050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:14.907050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:14.907164 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:14.907267 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:14.907448 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 10:02:14.907513 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 10:02:14.913267 24759 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b20394126a3846eda1b34cf9d7fa24ca: Generated new TSK 0
I20260808 10:02:14.913473 24759 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:14.915531 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 24634
W20260808 10:02:14.930830 24609 connection.cc:535] client connection to 127.0.0.1:36221 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36221): Connection reset by peer (error 104)
2026-08-08T10:02:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1563 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:14 dist-test-slave-gw5c krb5kdc[24783](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:14 dist-test-slave-gw5c krb5kdc[24783](info): set up 2 sockets
Aug 08 10:02:14 dist-test-slave-gw5c krb5kdc[24783](info): commencing operation
krb5kdc: starting...
W20260808 10:02:16.176170 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:16 dist-test-slave-gw5c krb5kdc[24783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183336, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 10:02:16.306317 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33555
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:16.390617 24800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:16.390851 24800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:16.390878 24800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:16.392102 24800 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:16.392149 24800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:16.392163 24800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:16.392176 24800 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:16.392218 24800 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:16.393747 24800 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:16.394021 24800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:16.394263 24800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:16.399247 24805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:16.399258 24812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:16.399257 24807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:16.399523 24800 server_base.cc:1034] running on GCE node
I20260808 10:02:16.399788 24800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:16.400097 24800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:16.401273 24800 hybrid_clock.cc:648] HybridClock initialized: now 1786183336401258 us; error 48 us; skew 500 ppm
Aug 08 10:02:16 dist-test-slave-gw5c krb5kdc[24783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183336, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:16.407693 24800 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 10:02:16.408191 24800 webserver.cc:460] Webserver started at http://127.0.0.1:41907/ using document root <none> and password file <none>
I20260808 10:02:16.408447 24800 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:16.408526 24800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:16.408686 24800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:16.409864 24800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "12abd678bac54d4d8fe88d1228874d6c"
format_stamp: "Formatted at 2026-08-08 10:02:16 on dist-test-slave-gw5c"
server_key: "13056ac17c416ab57085f5f8ea9bed5b"
server_key_iv: "e6f624b475b8d698cb80ead5161ce6ef"
server_key_version: "encryptionkey@0"
I20260808 10:02:16.410259 24800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "12abd678bac54d4d8fe88d1228874d6c"
format_stamp: "Formatted at 2026-08-08 10:02:16 on dist-test-slave-gw5c"
server_key: "13056ac17c416ab57085f5f8ea9bed5b"
server_key_iv: "e6f624b475b8d698cb80ead5161ce6ef"
server_key_version: "encryptionkey@0"
I20260808 10:02:16.411756 24800 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 10:02:16.412637 24824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:16.412824 24800 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:02:16.412940 24800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "12abd678bac54d4d8fe88d1228874d6c"
format_stamp: "Formatted at 2026-08-08 10:02:16 on dist-test-slave-gw5c"
server_key: "13056ac17c416ab57085f5f8ea9bed5b"
server_key_iv: "e6f624b475b8d698cb80ead5161ce6ef"
server_key_version: "encryptionkey@0"
I20260808 10:02:16.413033 24800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:16.433213 24800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:16.435206 24800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:16.435499 24800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:16.440049 24800 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33555
I20260808 10:02:16.440089 24907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33555 every 8 connection(s)
I20260808 10:02:16.440479 24800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:16.441470 24908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:16.442664 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 24800
I20260808 10:02:16.442821 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:16.443033 24863 external_mini_cluster.cc:1428] Setting key 392f40eb566b409f5aafdfd2c0b1c771
I20260808 10:02:16.444336 24908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c: Bootstrap starting.
I20260808 10:02:16.445036 24908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:16.445355 24908 log.cc:824] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:16.446091 24908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c: No bootstrap required, opened a new log
I20260808 10:02:16.448130 24908 raft_consensus.cc:348] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12abd678bac54d4d8fe88d1228874d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33555 } }
I20260808 10:02:16.448295 24908 raft_consensus.cc:374] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:16.448348 24908 raft_consensus.cc:729] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12abd678bac54d4d8fe88d1228874d6c, State: Initialized, Role: FOLLOWER
I20260808 10:02:16.448541 24908 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12abd678bac54d4d8fe88d1228874d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33555 } }
I20260808 10:02:16.448633 24908 raft_consensus.cc:388] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:16.448693 24908 raft_consensus.cc:482] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:16.448747 24908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:16.448906 24914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:16.443645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:33317 (local address 127.0.0.1:33555)
0808 10:02:16.443843 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:16.443851 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:16.443878 (+ 27us) server_negotiation.cc:407] Connection header received
0808 10:02:16.444309 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:16.444316 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:16.444366 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:16.444537 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:16.444791 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:16.445838 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:16.446703 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:16.447155 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:16.447288 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:16.448132 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:16.448135 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:16.448136 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:16.448302 (+ 166us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:16.448359 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:16.448375 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:16.448478 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:16.448611 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 10:02:16.448647 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":99,"threads_started":1}
I20260808 10:02:16.449445 24908 raft_consensus.cc:504] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12abd678bac54d4d8fe88d1228874d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33555 } }
I20260808 10:02:16.449572 24908 leader_election.cc:302] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12abd678bac54d4d8fe88d1228874d6c; no voters:
I20260808 10:02:16.449735 24908 leader_election.cc:288] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:16.449774 24919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:16.449877 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:16.449939 24919 raft_consensus.cc:686] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [term 1 LEADER]: Becoming Leader. State: Replica: 12abd678bac54d4d8fe88d1228874d6c, State: Running, Role: LEADER
I20260808 10:02:16.450013 24919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12abd678bac54d4d8fe88d1228874d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33555 } }
I20260808 10:02:16.450065 24908 sys_catalog.cc:564] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:16.450310 24920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12abd678bac54d4d8fe88d1228874d6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12abd678bac54d4d8fe88d1228874d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33555 } } }
I20260808 10:02:16.450385 24920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:16.450299 24919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12abd678bac54d4d8fe88d1228874d6c. Latest consensus state: current_term: 1 leader_uuid: "12abd678bac54d4d8fe88d1228874d6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12abd678bac54d4d8fe88d1228874d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33555 } } }
I20260808 10:02:16.450572 24919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:16.450699 24925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:16.451529 24925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:16.454085 24925 catalog_manager.cc:1347] Generated new cluster ID: c25b13563d414a348530bd958ea165aa
I20260808 10:02:16.454146 24925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:16.455188 24914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:16.451810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:44771 (local address 127.0.0.1:33555)
0808 10:02:16.451848 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:16.451850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:16.452077 (+ 227us) server_negotiation.cc:407] Connection header received
0808 10:02:16.452124 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:16.452125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:16.452137 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:16.452199 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:16.452373 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:16.452939 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:16.453679 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:16.453977 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:16.454045 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:16.454849 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:16.454851 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:16.454851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:16.454855 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:16.454868 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:16.454880 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:16.454920 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:16.455110 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 10:02:16.455118 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 10:02:16.466295 24925 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:16.466882 24925 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:16.469777 24925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 12abd678bac54d4d8fe88d1228874d6c: Generated new TSK 0
I20260808 10:02:16.469966 24925 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:16.474237 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 24800
W20260808 10:02:16.485488 24780 connection.cc:535] client connection to 127.0.0.1:33555 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33555): Connection reset by peer (error 104)
2026-08-08T10:02:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1554 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:16 dist-test-slave-gw5c krb5kdc[24952](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:16 dist-test-slave-gw5c krb5kdc[24952](info): set up 2 sockets
Aug 08 10:02:16 dist-test-slave-gw5c krb5kdc[24952](info): commencing operation
krb5kdc: starting...
W20260808 10:02:17.727308 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:17 dist-test-slave-gw5c krb5kdc[24952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183337, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 10:02:17.854478 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41877
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41877
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:17.940323 24972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:17.940596 24972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:17.940641 24972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:17.941864 24972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:17.941956 24972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:17.941990 24972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:17.942027 24972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:17.942076 24972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:17.943759 24972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41877
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:17.944078 24972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:17.944344 24972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:17.949484 24980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:17.949527 24979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:17.949520 24982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:17.949765 24972 server_base.cc:1034] running on GCE node
I20260808 10:02:17.950073 24972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:17.950383 24972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:17.951558 24972 hybrid_clock.cc:648] HybridClock initialized: now 1786183337951552 us; error 45 us; skew 500 ppm
Aug 08 10:02:17 dist-test-slave-gw5c krb5kdc[24952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183337, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:17.954223 24972 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 10:02:17.954736 24972 webserver.cc:460] Webserver started at http://127.0.0.1:40555/ using document root <none> and password file <none>
I20260808 10:02:17.954943 24972 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:17.955013 24972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:17.955130 24972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:17.956323 24972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "d6ff7eb4b4fc44a7b0efd2854eebfc37"
format_stamp: "Formatted at 2026-08-08 10:02:17 on dist-test-slave-gw5c"
server_key: "e7df9ff2111bd6f2f1a24953b4cd899a"
server_key_iv: "04a7de11501dc5542a38487758b2fc3d"
server_key_version: "encryptionkey@0"
I20260808 10:02:17.956645 24972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "d6ff7eb4b4fc44a7b0efd2854eebfc37"
format_stamp: "Formatted at 2026-08-08 10:02:17 on dist-test-slave-gw5c"
server_key: "e7df9ff2111bd6f2f1a24953b4cd899a"
server_key_iv: "04a7de11501dc5542a38487758b2fc3d"
server_key_version: "encryptionkey@0"
I20260808 10:02:17.958003 24972 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 10:02:17.958809 24989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:17.959024 24972 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:02:17.959124 24972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "d6ff7eb4b4fc44a7b0efd2854eebfc37"
format_stamp: "Formatted at 2026-08-08 10:02:17 on dist-test-slave-gw5c"
server_key: "e7df9ff2111bd6f2f1a24953b4cd899a"
server_key_iv: "04a7de11501dc5542a38487758b2fc3d"
server_key_version: "encryptionkey@0"
I20260808 10:02:17.959187 24972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:17.962594 24972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:17.964705 24972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:17.964820 24972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:17.968832 24972 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41877
I20260808 10:02:17.968899 25067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41877 every 8 connection(s)
I20260808 10:02:17.969261 24972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:17.970257 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 24972
I20260808 10:02:17.970402 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:17.970453 25068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:17.970638 24863 external_mini_cluster.cc:1428] Setting key cdf5b5d83b31fcd8db8863799ee7a3b0
I20260808 10:02:17.973449 25073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:17.971412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:46739 (local address 127.0.0.1:41877)
0808 10:02:17.971628 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:17.971636 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:17.971662 (+ 26us) server_negotiation.cc:407] Connection header received
0808 10:02:17.972117 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:17.972124 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:17.972148 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:17.972264 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:17.972967 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:17.972971 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:17.972971 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:17.972975 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:17.973013 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:17.973023 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:17.973087 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:17.973183 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 10:02:17.973244 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":106,"threads_started":1}
I20260808 10:02:17.974079 25068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37: Bootstrap starting.
I20260808 10:02:17.974469 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:17.974849 25068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:17.975138 25068 log.cc:824] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:17.976047 25068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37: No bootstrap required, opened a new log
I20260808 10:02:17.977079 25073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:17.976019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:35251 (local address 127.0.0.1:41877)
0808 10:02:17.976082 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:17.976084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:17.976227 (+ 143us) server_negotiation.cc:407] Connection header received
0808 10:02:17.976254 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:17.976255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:17.976260 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:17.976323 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:17.976866 (+ 543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:17.976867 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:17.976868 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:17.976872 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:17.976887 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:17.976891 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:17.976957 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:17.976996 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 10:02:17.977009 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 10:02:17.978382 25068 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6ff7eb4b4fc44a7b0efd2854eebfc37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41877 } }
I20260808 10:02:17.978551 25068 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:17.978600 25068 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6ff7eb4b4fc44a7b0efd2854eebfc37, State: Initialized, Role: FOLLOWER
I20260808 10:02:17.978734 25068 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6ff7eb4b4fc44a7b0efd2854eebfc37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41877 } }
I20260808 10:02:17.978834 25068 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:17.978876 25068 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:17.978932 25068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:17.979626 25068 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6ff7eb4b4fc44a7b0efd2854eebfc37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41877 } }
I20260808 10:02:17.979751 25068 leader_election.cc:302] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6ff7eb4b4fc44a7b0efd2854eebfc37; no voters:
I20260808 10:02:17.979956 25068 leader_election.cc:288] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:17.980002 25086 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:17.980181 25086 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [term 1 LEADER]: Becoming Leader. State: Replica: d6ff7eb4b4fc44a7b0efd2854eebfc37, State: Running, Role: LEADER
I20260808 10:02:17.980257 25068 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:17.980301 25086 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6ff7eb4b4fc44a7b0efd2854eebfc37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41877 } }
I20260808 10:02:17.980715 25088 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6ff7eb4b4fc44a7b0efd2854eebfc37. Latest consensus state: current_term: 1 leader_uuid: "d6ff7eb4b4fc44a7b0efd2854eebfc37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6ff7eb4b4fc44a7b0efd2854eebfc37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41877 } } }
I20260808 10:02:17.980741 25087 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6ff7eb4b4fc44a7b0efd2854eebfc37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6ff7eb4b4fc44a7b0efd2854eebfc37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41877 } } }
I20260808 10:02:17.980928 25087 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:17.981153 25088 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:17.981338 25097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:17.981812 25097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:17.983564 25097 catalog_manager.cc:1347] Generated new cluster ID: 1980c2907756491ab0454723e3dd7802
I20260808 10:02:17.983623 25097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:18.002583 25097 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:18.002841 25097 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:18.006549 25097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6ff7eb4b4fc44a7b0efd2854eebfc37: Generated new TSK 0
I20260808 10:02:18.006758 25097 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:18.009945 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 24972
2026-08-08T10:02:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1533 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:18 dist-test-slave-gw5c krb5kdc[25115](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:18 dist-test-slave-gw5c krb5kdc[25115](info): set up 2 sockets
Aug 08 10:02:18 dist-test-slave-gw5c krb5kdc[25115](info): commencing operation
krb5kdc: starting...
W20260808 10:02:19.277302 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.244s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:19 dist-test-slave-gw5c krb5kdc[25115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 10:02:19.410580 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39583
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:19.495042 25132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:19.495278 25132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:19.495306 25132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:19.496482 25132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:19.496531 25132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:19.496546 25132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:19.496557 25132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:19.496570 25132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:19.498081 25132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39583
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:19.498291 25132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:19.498485 25132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:19.503787 25138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:19.503985 25132 server_base.cc:1034] running on GCE node
W20260808 10:02:19.503799 25142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:19.503798 25140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:19.504419 25132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:19.504721 25132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:19.505872 25132 hybrid_clock.cc:648] HybridClock initialized: now 1786183339505855 us; error 31 us; skew 500 ppm
Aug 08 10:02:19 dist-test-slave-gw5c krb5kdc[25115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183339, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:19.508782 25132 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 10:02:19.509305 25132 webserver.cc:460] Webserver started at http://127.0.0.1:45749/ using document root <none> and password file <none>
I20260808 10:02:19.509577 25132 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:19.509652 25132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:19.509809 25132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:19.510936 25132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "fc8937400cc84c1d9b86f4ac1a9554a8"
format_stamp: "Formatted at 2026-08-08 10:02:19 on dist-test-slave-gw5c"
server_key: "408e6c8763d5736a2a52f8bd152756ab"
server_key_iv: "3f2dbf42e3a7a1e2376a6b5d2f016d4c"
server_key_version: "encryptionkey@0"
I20260808 10:02:19.511327 25132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "fc8937400cc84c1d9b86f4ac1a9554a8"
format_stamp: "Formatted at 2026-08-08 10:02:19 on dist-test-slave-gw5c"
server_key: "408e6c8763d5736a2a52f8bd152756ab"
server_key_iv: "3f2dbf42e3a7a1e2376a6b5d2f016d4c"
server_key_version: "encryptionkey@0"
I20260808 10:02:19.512782 25132 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:19.513767 25152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:19.513986 25132 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:19.514102 25132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "fc8937400cc84c1d9b86f4ac1a9554a8"
format_stamp: "Formatted at 2026-08-08 10:02:19 on dist-test-slave-gw5c"
server_key: "408e6c8763d5736a2a52f8bd152756ab"
server_key_iv: "3f2dbf42e3a7a1e2376a6b5d2f016d4c"
server_key_version: "encryptionkey@0"
I20260808 10:02:19.514182 25132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:19.530545 25132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:19.533257 25132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:19.533457 25132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:19.538090 25132 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39583
I20260808 10:02:19.538137 25238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39583 every 8 connection(s)
I20260808 10:02:19.538573 25132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:19.539474 25239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:19.541821 25239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8: Bootstrap starting.
I20260808 10:02:19.542439 25239 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:19.542749 25239 log.cc:824] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:19.543524 25239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8: No bootstrap required, opened a new log
I20260808 10:02:19.545147 25239 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc8937400cc84c1d9b86f4ac1a9554a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39583 } }
I20260808 10:02:19.545320 25239 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:19.545372 25239 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc8937400cc84c1d9b86f4ac1a9554a8, State: Initialized, Role: FOLLOWER
I20260808 10:02:19.545542 25239 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc8937400cc84c1d9b86f4ac1a9554a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39583 } }
I20260808 10:02:19.545631 25239 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:19.545671 25239 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:19.545722 25239 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:19.546275 25239 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc8937400cc84c1d9b86f4ac1a9554a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39583 } }
I20260808 10:02:19.546401 25239 leader_election.cc:302] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc8937400cc84c1d9b86f4ac1a9554a8; no voters:
I20260808 10:02:19.546630 25239 leader_election.cc:288] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:19.546660 25243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:19.546698 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 25132
I20260808 10:02:19.546783 25243 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [term 1 LEADER]: Becoming Leader. State: Replica: fc8937400cc84c1d9b86f4ac1a9554a8, State: Running, Role: LEADER
I20260808 10:02:19.546826 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:19.546927 25239 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:19.546927 25243 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc8937400cc84c1d9b86f4ac1a9554a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39583 } }
I20260808 10:02:19.547032 24863 external_mini_cluster.cc:1428] Setting key 6aa446ad49ff59400078d2973f0d7c81
I20260808 10:02:19.547298 25243 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc8937400cc84c1d9b86f4ac1a9554a8. Latest consensus state: current_term: 1 leader_uuid: "fc8937400cc84c1d9b86f4ac1a9554a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc8937400cc84c1d9b86f4ac1a9554a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39583 } } }
I20260808 10:02:19.547367 25243 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:19.547613 25252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:19.547585 25245 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc8937400cc84c1d9b86f4ac1a9554a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc8937400cc84c1d9b86f4ac1a9554a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39583 } } }
I20260808 10:02:19.547672 25245 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:19.548179 25252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:19.550202 25252 catalog_manager.cc:1347] Generated new cluster ID: b6deb43758924549b61ff6719fa23d1f
I20260808 10:02:19.550271 25252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 10:02:19 dist-test-slave-gw5c krb5kdc[25115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 10:02:19.559984 25260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:19.547877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:35875 (local address 127.0.0.1:39583)
0808 10:02:19.548308 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:19.548318 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:19.548352 (+ 34us) server_negotiation.cc:407] Connection header received
0808 10:02:19.548480 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:19.548487 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:19.548551 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:19.548701 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:19.549607 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:19.550994 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:19.552091 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:19.552742 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:19.552870 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:19.555909 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:19.555914 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:19.555915 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:19.555927 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:19.558026 (+ 2099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:19.558538 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:19.558542 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:19.558542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:19.558673 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:19.558949 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:19.558950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:19.558950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:19.559297 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:19.559532 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:19.559627 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 10:02:19.559733 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":93,"threads_started":1}
I20260808 10:02:19.561379 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:19.570649 25260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:19.563058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:54025 (local address 127.0.0.1:39583)
0808 10:02:19.563100 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:19.563102 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:19.563157 (+ 55us) server_negotiation.cc:407] Connection header received
0808 10:02:19.563235 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:19.563235 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:19.563244 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:19.563295 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:19.563964 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:19.564713 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:19.565738 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:19.566045 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:19.566105 (+ 60us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:19.567650 (+ 1545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:19.567652 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:19.567653 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:19.567661 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:19.569230 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:19.569737 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:19.569739 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:19.569739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:19.569820 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:19.570058 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:19.570059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:19.570059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:19.570203 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:19.570303 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:19.570486 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 10:02:19.570554 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 10:02:19.576493 25252 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:19.577257 25252 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:19.580839 25252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc8937400cc84c1d9b86f4ac1a9554a8: Generated new TSK 0
I20260808 10:02:19.581032 25252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:19.586969 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 25132
W20260808 10:02:19.599130 25111 connection.cc:535] client connection to 127.0.0.1:39583 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39583): Connection reset by peer (error 104)
2026-08-08T10:02:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1580 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:19 dist-test-slave-gw5c krb5kdc[25283](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:19 dist-test-slave-gw5c krb5kdc[25283](info): set up 2 sockets
Aug 08 10:02:19 dist-test-slave-gw5c krb5kdc[25283](info): commencing operation
krb5kdc: starting...
W20260808 10:02:20.843571 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:20 dist-test-slave-gw5c krb5kdc[25283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 10:02:20.972352 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33271
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33271
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:21.056854 25303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:21.057065 25303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:21.057089 25303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:21.058347 25303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:21.058393 25303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:21.058408 25303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:21.058421 25303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:21.058475 25303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:21.060032 25303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33271
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:21.060316 25303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:21.060555 25303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:21.065582 25310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:21.065596 25309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:21.065631 25303 server_base.cc:1034] running on GCE node
W20260808 10:02:21.065624 25316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:21.066008 25303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:21.066313 25303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:21.067453 25303 hybrid_clock.cc:648] HybridClock initialized: now 1786183341067433 us; error 39 us; skew 500 ppm
Aug 08 10:02:21 dist-test-slave-gw5c krb5kdc[25283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183341, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:21.069972 25303 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 10:02:21.070371 25303 webserver.cc:460] Webserver started at http://127.0.0.1:32981/ using document root <none> and password file <none>
I20260808 10:02:21.070590 25303 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:21.070634 25303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:21.070727 25303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:21.071864 25303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "d74712a74d6c4ec68c3337c3ae4760ea"
format_stamp: "Formatted at 2026-08-08 10:02:21 on dist-test-slave-gw5c"
server_key: "d5c5578c577d6c3ef124c7fa283479b6"
server_key_iv: "fef845e77c5fc4ed779c10cdfb9acee9"
server_key_version: "encryptionkey@0"
I20260808 10:02:21.072183 25303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "d74712a74d6c4ec68c3337c3ae4760ea"
format_stamp: "Formatted at 2026-08-08 10:02:21 on dist-test-slave-gw5c"
server_key: "d5c5578c577d6c3ef124c7fa283479b6"
server_key_iv: "fef845e77c5fc4ed779c10cdfb9acee9"
server_key_version: "encryptionkey@0"
I20260808 10:02:21.073546 25303 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:02:21.074358 25326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:21.074554 25303 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:21.074672 25303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "d74712a74d6c4ec68c3337c3ae4760ea"
format_stamp: "Formatted at 2026-08-08 10:02:21 on dist-test-slave-gw5c"
server_key: "d5c5578c577d6c3ef124c7fa283479b6"
server_key_iv: "fef845e77c5fc4ed779c10cdfb9acee9"
server_key_version: "encryptionkey@0"
I20260808 10:02:21.074759 25303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:21.103027 25303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:21.105245 25303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:21.105427 25303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:21.109952 25303 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33271
I20260808 10:02:21.109992 25401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33271 every 8 connection(s)
I20260808 10:02:21.110406 25303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:21.111514 25404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:21.114044 25404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea: Bootstrap starting.
I20260808 10:02:21.114728 25404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:21.115063 25404 log.cc:824] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:21.115931 25404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea: No bootstrap required, opened a new log
I20260808 10:02:21.117660 25404 raft_consensus.cc:348] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74712a74d6c4ec68c3337c3ae4760ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33271 } }
I20260808 10:02:21.117812 25404 raft_consensus.cc:374] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:21.117864 25404 raft_consensus.cc:729] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d74712a74d6c4ec68c3337c3ae4760ea, State: Initialized, Role: FOLLOWER
I20260808 10:02:21.118022 25404 consensus_queue.cc:260] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74712a74d6c4ec68c3337c3ae4760ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33271 } }
I20260808 10:02:21.118088 25404 raft_consensus.cc:388] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:21.118110 25404 raft_consensus.cc:482] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:21.118180 25404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:21.118738 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 25303
I20260808 10:02:21.118892 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:21.118927 25404 raft_consensus.cc:504] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74712a74d6c4ec68c3337c3ae4760ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33271 } }
I20260808 10:02:21.119064 25404 leader_election.cc:302] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d74712a74d6c4ec68c3337c3ae4760ea; no voters:
I20260808 10:02:21.119118 24863 external_mini_cluster.cc:1428] Setting key ffef7da67d574614db0eedd0021e539c
I20260808 10:02:21.119269 25404 leader_election.cc:288] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:21.119320 25410 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:21.119527 25410 raft_consensus.cc:686] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [term 1 LEADER]: Becoming Leader. State: Replica: d74712a74d6c4ec68c3337c3ae4760ea, State: Running, Role: LEADER
I20260808 10:02:21.119647 25404 sys_catalog.cc:564] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:21.119701 25410 consensus_queue.cc:237] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74712a74d6c4ec68c3337c3ae4760ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33271 } }
I20260808 10:02:21.120121 25410 sys_catalog.cc:455] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader d74712a74d6c4ec68c3337c3ae4760ea. Latest consensus state: current_term: 1 leader_uuid: "d74712a74d6c4ec68c3337c3ae4760ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74712a74d6c4ec68c3337c3ae4760ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33271 } } }
I20260808 10:02:21.120261 25410 sys_catalog.cc:458] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:21.120319 25416 sys_catalog.cc:455] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d74712a74d6c4ec68c3337c3ae4760ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74712a74d6c4ec68c3337c3ae4760ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33271 } } }
I20260808 10:02:21.120471 25416 sys_catalog.cc:458] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:21.120536 25424 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:21.121168 25424 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:21.122871 25424 catalog_manager.cc:1347] Generated new cluster ID: 5d73a8ae2a714cdea4f783e92d129a5d
I20260808 10:02:21.122927 25424 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:21.125931 25418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:21.119663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:57643 (local address 127.0.0.1:33271)
0808 10:02:21.119850 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:21.119859 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:21.120196 (+ 337us) server_negotiation.cc:407] Connection header received
0808 10:02:21.120549 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:21.120557 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:21.120623 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:21.120737 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:21.121128 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:21.122513 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:21.123650 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:21.124268 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:21.124403 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:21.125198 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:21.125202 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:21.125203 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:21.125424 (+ 221us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:21.125465 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:21.125481 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:21.125572 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:21.125662 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 10:02:21.125690 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":68,"threads_started":1}
I20260808 10:02:21.127141 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:21.132710 25418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:21.128756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:52587 (local address 127.0.0.1:33271)
0808 10:02:21.128791 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:21.128793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:21.128902 (+ 109us) server_negotiation.cc:407] Connection header received
0808 10:02:21.128933 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:21.128934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:21.128945 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:21.129015 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:21.129141 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:21.130286 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:21.131260 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:21.131636 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:21.131705 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:21.132446 (+ 741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:21.132448 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:21.132448 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:21.132453 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:21.132470 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:21.132475 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:21.132541 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:21.132617 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 10:02:21.132631 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 10:02:21.138329 25424 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:21.139055 25424 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:21.144264 25424 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d74712a74d6c4ec68c3337c3ae4760ea: Generated new TSK 0
I20260808 10:02:21.144460 25424 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:21.148783 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 25303
W20260808 10:02:21.162551 25279 connection.cc:535] client connection to 127.0.0.1:33271 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33271): Connection reset by peer (error 104)
2026-08-08T10:02:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1563 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:21 dist-test-slave-gw5c krb5kdc[25450](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:21 dist-test-slave-gw5c krb5kdc[25450](info): set up 2 sockets
Aug 08 10:02:21 dist-test-slave-gw5c krb5kdc[25450](info): commencing operation
krb5kdc: starting...
W20260808 10:02:22.402554 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:22 dist-test-slave-gw5c krb5kdc[25450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183342, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 10:02:22.530046 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43399
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:22.615955 25470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:22.616163 25470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:22.616186 25470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:22.617275 25470 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:22.617309 25470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:22.617324 25470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:22.617336 25470 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:22.617348 25470 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:22.618801 25470 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43399
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:22.619032 25470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:22.619210 25470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:22.624121 25481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:22.624120 25483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:22.624323 25470 server_base.cc:1034] running on GCE node
W20260808 10:02:22.624183 25479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:22.624702 25470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:22.624974 25470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:22.626121 25470 hybrid_clock.cc:648] HybridClock initialized: now 1786183342626104 us; error 42 us; skew 500 ppm
Aug 08 10:02:22 dist-test-slave-gw5c krb5kdc[25450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183342, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:22.632930 25470 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 10:02:22.633497 25470 webserver.cc:460] Webserver started at http://127.0.0.1:39503/ using document root <none> and password file <none>
I20260808 10:02:22.633752 25470 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:22.633827 25470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:22.633994 25470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:22.635109 25470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "e8de7a17f7d44771b09a164035b6471b"
format_stamp: "Formatted at 2026-08-08 10:02:22 on dist-test-slave-gw5c"
server_key: "f61b67dd03b87f0bef8b9fd7709d482d"
server_key_iv: "cc06f179bdaacb090827a1158014ea28"
server_key_version: "encryptionkey@0"
I20260808 10:02:22.635555 25470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "e8de7a17f7d44771b09a164035b6471b"
format_stamp: "Formatted at 2026-08-08 10:02:22 on dist-test-slave-gw5c"
server_key: "f61b67dd03b87f0bef8b9fd7709d482d"
server_key_iv: "cc06f179bdaacb090827a1158014ea28"
server_key_version: "encryptionkey@0"
I20260808 10:02:22.637058 25470 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:02:22.637835 25491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:22.638028 25470 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:02:22.638145 25470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "e8de7a17f7d44771b09a164035b6471b"
format_stamp: "Formatted at 2026-08-08 10:02:22 on dist-test-slave-gw5c"
server_key: "f61b67dd03b87f0bef8b9fd7709d482d"
server_key_iv: "cc06f179bdaacb090827a1158014ea28"
server_key_version: "encryptionkey@0"
I20260808 10:02:22.638240 25470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:22.641845 25470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:22.644097 25470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:22.644268 25470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:22.648628 25470 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43399
I20260808 10:02:22.648664 25564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43399 every 8 connection(s)
I20260808 10:02:22.649058 25470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:22.650125 25566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:22.652578 25566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b: Bootstrap starting.
I20260808 10:02:22.653143 25566 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:22.653405 25566 log.cc:824] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:22.654074 25566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b: No bootstrap required, opened a new log
I20260808 10:02:22.655887 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 25470
I20260808 10:02:22.656010 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:22.655918 25566 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8de7a17f7d44771b09a164035b6471b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43399 } }
I20260808 10:02:22.656116 25566 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:22.656155 25566 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8de7a17f7d44771b09a164035b6471b, State: Initialized, Role: FOLLOWER
I20260808 10:02:22.656227 24863 external_mini_cluster.cc:1428] Setting key dc314df729925521c5a1b5fd5ab76207
I20260808 10:02:22.656319 25566 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8de7a17f7d44771b09a164035b6471b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43399 } }
I20260808 10:02:22.656414 25566 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:22.656447 25566 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:22.656497 25566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:22.657686 25566 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8de7a17f7d44771b09a164035b6471b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43399 } }
I20260808 10:02:22.657820 25566 leader_election.cc:302] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8de7a17f7d44771b09a164035b6471b; no voters:
I20260808 10:02:22.658003 25566 leader_election.cc:288] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:22.658066 25574 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:22.658226 25574 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [term 1 LEADER]: Becoming Leader. State: Replica: e8de7a17f7d44771b09a164035b6471b, State: Running, Role: LEADER
I20260808 10:02:22.658308 25566 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:22.658391 25574 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8de7a17f7d44771b09a164035b6471b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43399 } }
I20260808 10:02:22.658691 25573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:22.656834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:54689 (local address 127.0.0.1:43399)
0808 10:02:22.657043 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:22.657053 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:22.657093 (+ 40us) server_negotiation.cc:407] Connection header received
0808 10:02:22.657197 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:22.657203 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:22.657226 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:22.657339 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:22.658143 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:22.658148 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:22.658149 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:22.658154 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:22.658204 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:22.658222 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:22.658286 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:22.658448 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 10:02:22.658506 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":130,"threads_started":1}
I20260808 10:02:22.658838 25574 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8de7a17f7d44771b09a164035b6471b. Latest consensus state: current_term: 1 leader_uuid: "e8de7a17f7d44771b09a164035b6471b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8de7a17f7d44771b09a164035b6471b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43399 } } }
I20260808 10:02:22.658910 25574 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:22.659422 25576 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8de7a17f7d44771b09a164035b6471b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8de7a17f7d44771b09a164035b6471b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43399 } } }
I20260808 10:02:22.659636 25576 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:22.659669 25592 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:22.659747 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:22.660249 25592 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:22.662318 25592 catalog_manager.cc:1347] Generated new cluster ID: ea8d875f509f4826a924f4e38f752582
I20260808 10:02:22.662375 25592 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:22.662562 25573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:22.661383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:60469 (local address 127.0.0.1:43399)
0808 10:02:22.661417 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:22.661419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:22.661576 (+ 157us) server_negotiation.cc:407] Connection header received
0808 10:02:22.661658 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:22.661659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:22.661666 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:22.661723 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:22.662331 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:22.662333 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:22.662333 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:22.662338 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:22.662353 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:22.662358 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:22.662406 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:22.662490 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 10:02:22.662508 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 10:02:22.672021 25592 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:22.672211 25592 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:22.692312 25592 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8de7a17f7d44771b09a164035b6471b: Generated new TSK 0
I20260808 10:02:22.692589 25592 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:22.695041 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 25470
2026-08-08T10:02:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1546 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:22 dist-test-slave-gw5c krb5kdc[25619](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:22 dist-test-slave-gw5c krb5kdc[25619](info): set up 2 sockets
Aug 08 10:02:22 dist-test-slave-gw5c krb5kdc[25619](info): commencing operation
krb5kdc: starting...
W20260808 10:02:23.951304 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:24 dist-test-slave-gw5c krb5kdc[25619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:02:24.078420 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:34519
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:43671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:34519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:24.164999 25640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:24.165262 25640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:24.165305 25640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:24.166491 25640 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:24.166566 25640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:24.166591 25640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:24.166625 25640 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:24.166674 25640 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:24.168520 25640 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:43671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:34519
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:34519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:24.168853 25640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:24.169117 25640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:24.174471 25655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:24.174582 25640 server_base.cc:1034] running on GCE node
W20260808 10:02:24.174397 25652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:24.174391 25653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:24.174922 25640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:24.175263 25640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:24.176426 25640 hybrid_clock.cc:648] HybridClock initialized: now 1786183344176404 us; error 40 us; skew 500 ppm
Aug 08 10:02:24 dist-test-slave-gw5c krb5kdc[25619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183344, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:24.179227 25640 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:02:24.179767 25640 webserver.cc:460] Webserver started at http://127.24.71.254:37715/ using document root <none> and password file <none>
I20260808 10:02:24.180018 25640 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:24.180066 25640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:24.180225 25640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:24.181313 25640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "ff8359e0478640b6ac0b6c469ccb7d98"
format_stamp: "Formatted at 2026-08-08 10:02:24 on dist-test-slave-gw5c"
server_key: "f9c433f8ce96c25a62f964fd0b551d62"
server_key_iv: "a9050730c872248fb1c9c0f9d449c184"
server_key_version: "encryptionkey@0"
I20260808 10:02:24.181684 25640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "ff8359e0478640b6ac0b6c469ccb7d98"
format_stamp: "Formatted at 2026-08-08 10:02:24 on dist-test-slave-gw5c"
server_key: "f9c433f8ce96c25a62f964fd0b551d62"
server_key_iv: "a9050730c872248fb1c9c0f9d449c184"
server_key_version: "encryptionkey@0"
I20260808 10:02:24.183048 25640 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:02:24.183861 25663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:24.184054 25640 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:24.184170 25640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "ff8359e0478640b6ac0b6c469ccb7d98"
format_stamp: "Formatted at 2026-08-08 10:02:24 on dist-test-slave-gw5c"
server_key: "f9c433f8ce96c25a62f964fd0b551d62"
server_key_iv: "a9050730c872248fb1c9c0f9d449c184"
server_key_version: "encryptionkey@0"
I20260808 10:02:24.184250 25640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:24.207163 25640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:24.209719 25640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:24.209896 25640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:24.214216 25640 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:34519
I20260808 10:02:24.214257 25732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:34519 every 8 connection(s)
I20260808 10:02:24.214659 25640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:24.214843 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 25640
I20260808 10:02:24.214969 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:24.215204 24863 external_mini_cluster.cc:1428] Setting key d3ee19d2e4bce87048d34ed7217f3748
I20260808 10:02:24.215845 25733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:24.219172 25733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98: Bootstrap starting.
I20260808 10:02:24.219889 25733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:24.220202 25733 log.cc:824] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:24.220870 25733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98: No bootstrap required, opened a new log
Aug 08 10:02:24 dist-test-slave-gw5c krb5kdc[25619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:02:24.223243 25733 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff8359e0478640b6ac0b6c469ccb7d98" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34519 } }
I20260808 10:02:24.223425 25733 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:24.223508 25733 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff8359e0478640b6ac0b6c469ccb7d98, State: Initialized, Role: FOLLOWER
I20260808 10:02:24.223688 25733 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff8359e0478640b6ac0b6c469ccb7d98" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34519 } }
I20260808 10:02:24.223788 25733 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:24.223834 25733 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:24.223883 25733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:24.224407 25733 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff8359e0478640b6ac0b6c469ccb7d98" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34519 } }
I20260808 10:02:24.224536 25733 leader_election.cc:302] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff8359e0478640b6ac0b6c469ccb7d98; no voters:
I20260808 10:02:24.224720 25733 leader_election.cc:288] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:24.224774 25738 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:24.224967 25738 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [term 1 LEADER]: Becoming Leader. State: Replica: ff8359e0478640b6ac0b6c469ccb7d98, State: Running, Role: LEADER
I20260808 10:02:24.225001 25733 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:24.226225 25738 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff8359e0478640b6ac0b6c469ccb7d98" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34519 } }
I20260808 10:02:24.226914 25736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:24.215865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40573 (local address 127.24.71.254:34519)
0808 10:02:24.216073 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:24.216083 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:24.216119 (+ 36us) server_negotiation.cc:407] Connection header received
0808 10:02:24.216570 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:24.216576 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:24.216620 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:24.216733 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:24.217573 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:24.218479 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:24.219545 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:24.219936 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:24.220072 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:24.222836 (+ 2764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:24.222839 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:24.222839 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:24.222849 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:24.224771 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:24.225283 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:24.225287 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:24.225287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:24.225389 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:24.225641 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:24.225643 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:24.225643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:24.225928 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:24.226133 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:24.226563 (+ 430us) server_negotiation.cc:299] Negotiation successful
0808 10:02:24.226684 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":119,"threads_started":1}
I20260808 10:02:24.227007 25741 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff8359e0478640b6ac0b6c469ccb7d98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff8359e0478640b6ac0b6c469ccb7d98" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34519 } } }
I20260808 10:02:24.227087 25741 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [sys.catalog]: This master's current role is: LEADER
W20260808 10:02:24.227347 25759 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 10:02:24.227434 25759 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 10:02:24.227577 25739 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff8359e0478640b6ac0b6c469ccb7d98. Latest consensus state: current_term: 1 leader_uuid: "ff8359e0478640b6ac0b6c469ccb7d98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff8359e0478640b6ac0b6c469ccb7d98" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34519 } } }
I20260808 10:02:24.227659 25739 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:24.227923 25761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:24.228140 25761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:24.228232 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:24.229596 25761 catalog_manager.cc:1347] Generated new cluster ID: dd6c3913ca0b4de8bf231e92f41f295c
I20260808 10:02:24.229661 25761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:24.237439 25736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:24.229761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58031 (local address 127.24.71.254:34519)
0808 10:02:24.229818 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:24.229820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:24.230032 (+ 212us) server_negotiation.cc:407] Connection header received
0808 10:02:24.230168 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:24.230169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:24.230179 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:24.230246 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:24.230843 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:24.231620 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:24.232574 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:24.232922 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:24.233000 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:24.234349 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:24.234351 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:24.234351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:24.234359 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:24.236046 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:24.236481 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:24.236482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:24.236482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:24.236547 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:24.236779 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:24.236780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:24.236780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:24.236922 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:24.237032 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:24.237274 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 10:02:24.237342 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 10:02:24.264084 25761 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:24.264678 25761 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:24.266500 25761 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff8359e0478640b6ac0b6c469ccb7d98: Generated new TSK 0
I20260808 10:02:24.266700 25761 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:24.270469 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 25640
W20260808 10:02:24.286003 25616 connection.cc:535] client connection to 127.24.71.254:34519 recv error: Network error: failed to read from TLS socket (remote: 127.24.71.254:34519): Connection reset by peer (error 104)
2026-08-08T10:02:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1576 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:24 dist-test-slave-gw5c krb5kdc[25788](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:24 dist-test-slave-gw5c krb5kdc[25788](info): set up 2 sockets
Aug 08 10:02:24 dist-test-slave-gw5c krb5kdc[25788](info): commencing operation
krb5kdc: starting...
W20260808 10:02:25.533517 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:25 dist-test-slave-gw5c krb5kdc[25788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:02:25.664525 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:34255
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:40367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:34255
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:25.750036 25804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:25.750310 25804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:25.750353 25804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:25.751531 25804 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:25.751610 25804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:25.751636 25804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:25.751657 25804 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:25.751688 25804 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:25.753199 25804 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:40367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:34255
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:34255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:25.753505 25804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:25.753747 25804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:25.758901 25811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:25.758919 25815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:25.758908 25813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:25.759232 25804 server_base.cc:1034] running on GCE node
I20260808 10:02:25.759547 25804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:25.759856 25804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:25.761016 25804 hybrid_clock.cc:648] HybridClock initialized: now 1786183345760985 us; error 51 us; skew 500 ppm
Aug 08 10:02:25 dist-test-slave-gw5c krb5kdc[25788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183345, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:25.763787 25804 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:02:25.764290 25804 webserver.cc:460] Webserver started at http://127.24.71.254:37195/ using document root <none> and password file <none>
I20260808 10:02:25.764545 25804 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:25.764592 25804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:25.764760 25804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:25.765836 25804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "d67b14edc20b404db5cf915ffe56cf18"
format_stamp: "Formatted at 2026-08-08 10:02:25 on dist-test-slave-gw5c"
server_key: "62e721c2b79f12335328217b098a7074"
server_key_iv: "1391419e1b9c62b8453f7ac5a6e744de"
server_key_version: "encryptionkey@0"
I20260808 10:02:25.766211 25804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "d67b14edc20b404db5cf915ffe56cf18"
format_stamp: "Formatted at 2026-08-08 10:02:25 on dist-test-slave-gw5c"
server_key: "62e721c2b79f12335328217b098a7074"
server_key_iv: "1391419e1b9c62b8453f7ac5a6e744de"
server_key_version: "encryptionkey@0"
I20260808 10:02:25.767683 25804 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:02:25.768435 25826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:25.768620 25804 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:02:25.768731 25804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "d67b14edc20b404db5cf915ffe56cf18"
format_stamp: "Formatted at 2026-08-08 10:02:25 on dist-test-slave-gw5c"
server_key: "62e721c2b79f12335328217b098a7074"
server_key_iv: "1391419e1b9c62b8453f7ac5a6e744de"
server_key_version: "encryptionkey@0"
I20260808 10:02:25.768810 25804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:25.778522 25804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:25.780694 25804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:25.780871 25804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:25.785391 25804 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:34255
I20260808 10:02:25.785426 25901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:34255 every 8 connection(s)
I20260808 10:02:25.785804 25804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:25.786773 25903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:25.789099 25903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18: Bootstrap starting.
I20260808 10:02:25.789661 25903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:25.789916 25903 log.cc:824] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:25.790547 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 25804
I20260808 10:02:25.790627 25903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18: No bootstrap required, opened a new log
I20260808 10:02:25.790652 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:25.790835 24863 external_mini_cluster.cc:1428] Setting key 48cd0be89db5381979020b5123a05a5e
I20260808 10:02:25.793756 25903 raft_consensus.cc:348] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67b14edc20b404db5cf915ffe56cf18" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34255 } }
I20260808 10:02:25.793926 25903 raft_consensus.cc:374] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:25.793957 25903 raft_consensus.cc:729] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d67b14edc20b404db5cf915ffe56cf18, State: Initialized, Role: FOLLOWER
I20260808 10:02:25.794082 25903 consensus_queue.cc:260] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67b14edc20b404db5cf915ffe56cf18" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34255 } }
I20260808 10:02:25.794179 25903 raft_consensus.cc:388] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:25.794214 25903 raft_consensus.cc:482] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:25.794268 25903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:25.794880 25903 raft_consensus.cc:504] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67b14edc20b404db5cf915ffe56cf18" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34255 } }
I20260808 10:02:25.794988 25903 leader_election.cc:302] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d67b14edc20b404db5cf915ffe56cf18; no voters:
I20260808 10:02:25.795140 25903 leader_election.cc:288] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:25.795197 25908 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:25.795410 25908 raft_consensus.cc:686] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [term 1 LEADER]: Becoming Leader. State: Replica: d67b14edc20b404db5cf915ffe56cf18, State: Running, Role: LEADER
I20260808 10:02:25.795414 25903 sys_catalog.cc:564] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:25.796518 25908 consensus_queue.cc:237] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67b14edc20b404db5cf915ffe56cf18" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34255 } }
I20260808 10:02:25.797188 25910 sys_catalog.cc:455] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d67b14edc20b404db5cf915ffe56cf18. Latest consensus state: current_term: 1 leader_uuid: "d67b14edc20b404db5cf915ffe56cf18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67b14edc20b404db5cf915ffe56cf18" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34255 } } }
I20260808 10:02:25.797369 25910 sys_catalog.cc:458] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:25.797427 25907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:25.791467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36719 (local address 127.24.71.254:34255)
0808 10:02:25.791660 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:25.791670 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:25.791706 (+ 36us) server_negotiation.cc:407] Connection header received
0808 10:02:25.792181 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:25.792190 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:25.792256 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:25.792412 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:25.792584 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:25.794029 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:25.794897 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:25.795565 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:25.795706 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:25.796514 (+ 808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:25.796518 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:25.796519 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:25.796728 (+ 209us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:25.796770 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:25.796786 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:25.796876 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:25.797187 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 10:02:25.797217 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":80,"threads_started":1}
I20260808 10:02:25.797096 25909 sys_catalog.cc:455] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d67b14edc20b404db5cf915ffe56cf18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67b14edc20b404db5cf915ffe56cf18" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 34255 } } }
I20260808 10:02:25.797642 25909 sys_catalog.cc:458] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18 [sys.catalog]: This master's current role is: LEADER
W20260808 10:02:25.798022 25929 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 10:02:25.798077 25929 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 10:02:25.798183 25931 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:25.798431 25931 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:25.799142 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:25.799953 25931 catalog_manager.cc:1347] Generated new cluster ID: f35500468e6746359def26221e7030f0
I20260808 10:02:25.800020 25931 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:25.804499 25907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:25.800723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44377 (local address 127.24.71.254:34255)
0808 10:02:25.800790 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:25.800792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:25.800994 (+ 202us) server_negotiation.cc:407] Connection header received
0808 10:02:25.801068 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:25.801069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:25.801079 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:25.801135 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:25.801278 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:25.801982 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:25.803034 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:25.803341 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:25.803431 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:25.804222 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:25.804223 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:25.804224 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:25.804230 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:25.804246 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:25.804250 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:25.804305 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:25.804406 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 10:02:25.804418 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 10:02:25.808853 25931 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:25.809628 25931 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:25.815882 25931 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d67b14edc20b404db5cf915ffe56cf18: Generated new TSK 0
I20260808 10:02:25.816108 25931 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:25.821398 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 25804
W20260808 10:02:25.834093 25779 connection.cc:535] client connection to 127.24.71.254:34255 recv error: Network error: failed to read from TLS socket (remote: 127.24.71.254:34255): Connection reset by peer (error 104)
2026-08-08T10:02:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1548 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:25 dist-test-slave-gw5c krb5kdc[25954](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:25 dist-test-slave-gw5c krb5kdc[25954](info): set up 2 sockets
Aug 08 10:02:25 dist-test-slave-gw5c krb5kdc[25954](info): commencing operation
krb5kdc: starting...
W20260808 10:02:27.059955 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:27 dist-test-slave-gw5c krb5kdc[25954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:02:27.190754 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:45389
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:45389
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:27.277396 25976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:27.277686 25976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:27.277730 25976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:27.278936 25976 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:27.279042 25976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:27.279072 25976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:27.279106 25976 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:27.279142 25976 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:27.280764 25976 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:45389
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:45389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:27.281096 25976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:27.281373 25976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:27.286566 25986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:27.286576 25991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:27.286576 25985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:27.286885 25976 server_base.cc:1034] running on GCE node
I20260808 10:02:27.287189 25976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:27.287560 25976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:27.288746 25976 hybrid_clock.cc:648] HybridClock initialized: now 1786183347288729 us; error 27 us; skew 500 ppm
Aug 08 10:02:27 dist-test-slave-gw5c krb5kdc[25954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183347, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:27.291327 25976 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:02:27.291816 25976 webserver.cc:460] Webserver started at http://127.24.71.254:38343/ using document root <none> and password file <none>
I20260808 10:02:27.292088 25976 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:27.292160 25976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:27.292316 25976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:27.293438 25976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "e6e9d8d06ccf4cba8d6dca4898e9ca9b"
format_stamp: "Formatted at 2026-08-08 10:02:27 on dist-test-slave-gw5c"
server_key: "76120cff2141cf19d58f91b78cad4fed"
server_key_iv: "2eeb9f11608a3f4cf40ff63c69657e28"
server_key_version: "encryptionkey@0"
I20260808 10:02:27.293826 25976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "e6e9d8d06ccf4cba8d6dca4898e9ca9b"
format_stamp: "Formatted at 2026-08-08 10:02:27 on dist-test-slave-gw5c"
server_key: "76120cff2141cf19d58f91b78cad4fed"
server_key_iv: "2eeb9f11608a3f4cf40ff63c69657e28"
server_key_version: "encryptionkey@0"
I20260808 10:02:27.295333 25976 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 10:02:27.296187 25999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:27.296429 25976 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 10:02:27.296554 25976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "e6e9d8d06ccf4cba8d6dca4898e9ca9b"
format_stamp: "Formatted at 2026-08-08 10:02:27 on dist-test-slave-gw5c"
server_key: "76120cff2141cf19d58f91b78cad4fed"
server_key_iv: "2eeb9f11608a3f4cf40ff63c69657e28"
server_key_version: "encryptionkey@0"
I20260808 10:02:27.296639 25976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:27.300156 25976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:27.302335 25976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:27.302510 25976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:27.306769 25976 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:45389
I20260808 10:02:27.306833 26068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:45389 every 8 connection(s)
I20260808 10:02:27.307221 25976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:27.308429 26069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:27.310844 26069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b: Bootstrap starting.
I20260808 10:02:27.311566 26069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:27.311869 26069 log.cc:824] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:27.312691 26069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b: No bootstrap required, opened a new log
I20260808 10:02:27.314303 26069 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6e9d8d06ccf4cba8d6dca4898e9ca9b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 45389 } }
I20260808 10:02:27.314453 26069 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:27.314503 26069 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e9d8d06ccf4cba8d6dca4898e9ca9b, State: Initialized, Role: FOLLOWER
I20260808 10:02:27.314677 26069 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6e9d8d06ccf4cba8d6dca4898e9ca9b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 45389 } }
I20260808 10:02:27.314741 26069 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:27.314781 26069 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:27.314834 26069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:27.315793 26069 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6e9d8d06ccf4cba8d6dca4898e9ca9b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 45389 } }
I20260808 10:02:27.315919 26069 leader_election.cc:302] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6e9d8d06ccf4cba8d6dca4898e9ca9b; no voters:
I20260808 10:02:27.316107 26069 leader_election.cc:288] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:27.316172 26072 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:27.316375 26069 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:27.316372 26072 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [term 1 LEADER]: Becoming Leader. State: Replica: e6e9d8d06ccf4cba8d6dca4898e9ca9b, State: Running, Role: LEADER
I20260808 10:02:27.316578 26072 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6e9d8d06ccf4cba8d6dca4898e9ca9b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 45389 } }
I20260808 10:02:27.316862 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 25976
I20260808 10:02:27.317004 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:27.317085 26073 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6e9d8d06ccf4cba8d6dca4898e9ca9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6e9d8d06ccf4cba8d6dca4898e9ca9b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 45389 } } }
I20260808 10:02:27.317166 26073 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:27.317235 24863 external_mini_cluster.cc:1428] Setting key 5c3826d50b6be533ffa5bb9da68765c7
I20260808 10:02:27.317716 26082 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:27.318368 26074 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6e9d8d06ccf4cba8d6dca4898e9ca9b. Latest consensus state: current_term: 1 leader_uuid: "e6e9d8d06ccf4cba8d6dca4898e9ca9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6e9d8d06ccf4cba8d6dca4898e9ca9b" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 45389 } } }
I20260808 10:02:27.318497 26074 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:27.318382 26082 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:27.319890 26094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:27.317947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52143 (local address 127.24.71.254:45389)
0808 10:02:27.318324 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:27.318334 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:27.318368 (+ 34us) server_negotiation.cc:407] Connection header received
0808 10:02:27.318494 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:27.318502 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:27.318545 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:27.318697 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:27.319435 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:27.319438 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:27.319439 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:27.319443 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:27.319484 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:27.319504 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:27.319587 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:27.319679 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 10:02:27.319721 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":68,"threads_started":1}
I20260808 10:02:27.320672 26082 catalog_manager.cc:1347] Generated new cluster ID: 0f7f87af21cb4c419f8c07073c3a781d
I20260808 10:02:27.320722 26082 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:27.320869 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:27.323455 26094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:27.322349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53323 (local address 127.24.71.254:45389)
0808 10:02:27.322385 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:27.322387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:27.322444 (+ 57us) server_negotiation.cc:407] Connection header received
0808 10:02:27.322514 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:27.322515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:27.322519 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:27.322588 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:27.323193 (+ 605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:27.323194 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:27.323194 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:27.323198 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:27.323213 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:27.323218 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:27.323281 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:27.323336 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 10:02:27.323349 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 10:02:27.327579 26082 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:27.327754 26082 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:27.333431 26082 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6e9d8d06ccf4cba8d6dca4898e9ca9b: Generated new TSK 0
I20260808 10:02:27.333654 26082 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:27.337839 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 25976
2026-08-08T10:02:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1522 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:27 dist-test-slave-gw5c krb5kdc[26110](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:27 dist-test-slave-gw5c krb5kdc[26110](info): set up 2 sockets
Aug 08 10:02:27 dist-test-slave-gw5c krb5kdc[26110](info): commencing operation
krb5kdc: starting...
W20260808 10:02:28.596810 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:28 dist-test-slave-gw5c krb5kdc[26110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:02:28.722877 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:36289
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:36289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:28.807219 26132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:28.807515 26132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:28.807559 26132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:28.808720 26132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:28.808795 26132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:28.808820 26132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:28.808841 26132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:28.808869 26132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:28.810344 26132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:36289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:36289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:28.810633 26132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:28.810861 26132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:28.815642 26137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:28.815660 26139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:28.815647 26141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:28.815830 26132 server_base.cc:1034] running on GCE node
I20260808 10:02:28.816095 26132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:28.816380 26132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:28.817553 26132 hybrid_clock.cc:648] HybridClock initialized: now 1786183348817520 us; error 44 us; skew 500 ppm
Aug 08 10:02:28 dist-test-slave-gw5c krb5kdc[26110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183348, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:28.824213 26132 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:02:28.824872 26132 webserver.cc:460] Webserver started at http://127.24.71.254:44591/ using document root <none> and password file <none>
I20260808 10:02:28.825155 26132 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:28.825207 26132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:28.825304 26132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:28.826421 26132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "941af76a6a024220bdb102fad33963d6"
format_stamp: "Formatted at 2026-08-08 10:02:28 on dist-test-slave-gw5c"
server_key: "12bdce89badd1eb745df1b5b6e92d661"
server_key_iv: "a0bad608e40283b95c0b094399fa38f6"
server_key_version: "encryptionkey@0"
I20260808 10:02:28.826730 26132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "941af76a6a024220bdb102fad33963d6"
format_stamp: "Formatted at 2026-08-08 10:02:28 on dist-test-slave-gw5c"
server_key: "12bdce89badd1eb745df1b5b6e92d661"
server_key_iv: "a0bad608e40283b95c0b094399fa38f6"
server_key_version: "encryptionkey@0"
I20260808 10:02:28.828145 26132 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:02:28.828938 26151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:28.829227 26132 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:28.829344 26132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "941af76a6a024220bdb102fad33963d6"
format_stamp: "Formatted at 2026-08-08 10:02:28 on dist-test-slave-gw5c"
server_key: "12bdce89badd1eb745df1b5b6e92d661"
server_key_iv: "a0bad608e40283b95c0b094399fa38f6"
server_key_version: "encryptionkey@0"
I20260808 10:02:28.829420 26132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:28.841593 26132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:28.843550 26132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:28.843726 26132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:28.848348 26132 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:36289
I20260808 10:02:28.848757 26132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:28.848809 26240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:36289 every 8 connection(s)
I20260808 10:02:28.849504 26241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:28.852293 26241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6: Bootstrap starting.
I20260808 10:02:28.853003 26241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:28.853363 26241 log.cc:824] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:28.854152 26241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6: No bootstrap required, opened a new log
I20260808 10:02:28.856098 26241 raft_consensus.cc:348] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "941af76a6a024220bdb102fad33963d6" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 36289 } }
I20260808 10:02:28.856288 26241 raft_consensus.cc:374] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:28.856372 26241 raft_consensus.cc:729] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941af76a6a024220bdb102fad33963d6, State: Initialized, Role: FOLLOWER
I20260808 10:02:28.856587 26241 consensus_queue.cc:260] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "941af76a6a024220bdb102fad33963d6" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 36289 } }
I20260808 10:02:28.856710 26241 raft_consensus.cc:388] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:28.856770 26241 raft_consensus.cc:482] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:28.856832 26241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:28.857838 26241 raft_consensus.cc:504] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "941af76a6a024220bdb102fad33963d6" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 36289 } }
I20260808 10:02:28.857978 26241 leader_election.cc:302] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 941af76a6a024220bdb102fad33963d6; no voters:
I20260808 10:02:28.858197 26241 leader_election.cc:288] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:28.858244 26245 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:28.858469 26245 raft_consensus.cc:686] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [term 1 LEADER]: Becoming Leader. State: Replica: 941af76a6a024220bdb102fad33963d6, State: Running, Role: LEADER
I20260808 10:02:28.858501 26241 sys_catalog.cc:564] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:28.858564 26245 consensus_queue.cc:237] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "941af76a6a024220bdb102fad33963d6" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 36289 } }
I20260808 10:02:28.858817 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 26132
I20260808 10:02:28.858954 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:28.859179 24863 external_mini_cluster.cc:1428] Setting key 3897e4a390f7349d6ff5317144b8fc4b
I20260808 10:02:28.859752 26246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "941af76a6a024220bdb102fad33963d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "941af76a6a024220bdb102fad33963d6" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 36289 } } }
I20260808 10:02:28.859843 26246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:28.860105 26262 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:28.860423 26247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 941af76a6a024220bdb102fad33963d6. Latest consensus state: current_term: 1 leader_uuid: "941af76a6a024220bdb102fad33963d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "941af76a6a024220bdb102fad33963d6" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 36289 } } }
I20260808 10:02:28.860509 26247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:28.860723 26262 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:28.862582 26262 catalog_manager.cc:1347] Generated new cluster ID: 5f1ad35f5a3c4e1b93c8dbfbd3b66335
I20260808 10:02:28.862648 26262 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 10:02:28 dist-test-slave-gw5c krb5kdc[26110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:02:28.872190 26262 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:28.872835 26262 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:28.873329 26263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:28.859885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38825 (local address 127.24.71.254:36289)
0808 10:02:28.860087 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:28.860099 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:28.860761 (+ 662us) server_negotiation.cc:407] Connection header received
0808 10:02:28.860916 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:28.860924 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:28.860989 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:28.861153 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:28.861939 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:28.863493 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:28.864540 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:28.865234 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:28.865386 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:28.868539 (+ 3153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:28.868544 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:28.868544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:28.868556 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:28.871261 (+ 2705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:28.871790 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:28.871795 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:28.871795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:28.871954 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:28.872196 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:28.872197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:28.872197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:28.872561 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:28.872754 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:28.872871 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 10:02:28.873055 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":101,"threads_started":1}
I20260808 10:02:28.874742 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:28.878669 26262 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 941af76a6a024220bdb102fad33963d6: Generated new TSK 0
I20260808 10:02:28.878859 26262 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:28.886152 26263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:28.878476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48727 (local address 127.24.71.254:36289)
0808 10:02:28.878554 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:28.878556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:28.878789 (+ 233us) server_negotiation.cc:407] Connection header received
0808 10:02:28.878906 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:28.878907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:28.878924 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:28.879016 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:28.879657 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:28.880563 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:28.881282 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:28.881625 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:28.881714 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:28.882976 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:28.882978 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:28.882978 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:28.882987 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:28.884916 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:28.885279 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:28.885280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:28.885280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:28.885355 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:28.885557 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:28.885558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:28.885558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:28.885707 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:28.885822 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:28.885897 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 10:02:28.886008 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 10:02:28.888509 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 26132
2026-08-08T10:02:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1541 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:28 dist-test-slave-gw5c krb5kdc[26291](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:28 dist-test-slave-gw5c krb5kdc[26291](info): set up 2 sockets
Aug 08 10:02:28 dist-test-slave-gw5c krb5kdc[26291](info): commencing operation
krb5kdc: starting...
W20260808 10:02:30.138582 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:30 dist-test-slave-gw5c krb5kdc[26291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183350, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:02:30.269963 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:45917
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:38161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:45917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:30.354375 26313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:30.354627 26313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:30.354667 26313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:30.355885 26313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:30.355949 26313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:30.355973 26313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:30.355994 26313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:30.356024 26313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:30.357519 26313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:38161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:45917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:45917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:30.357795 26313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:30.358031 26313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:30.362987 26331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:30.363014 26326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:30.363010 26327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:30.363373 26313 server_base.cc:1034] running on GCE node
I20260808 10:02:30.363709 26313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:30.364009 26313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:30.365175 26313 hybrid_clock.cc:648] HybridClock initialized: now 1786183350365153 us; error 40 us; skew 500 ppm
Aug 08 10:02:30 dist-test-slave-gw5c krb5kdc[26291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183350, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:30.367677 26313 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:02:30.368232 26313 webserver.cc:460] Webserver started at http://127.24.71.254:36521/ using document root <none> and password file <none>
I20260808 10:02:30.368430 26313 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:30.368472 26313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:30.368564 26313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:30.369606 26313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "fc6f2767afad409ebcaf9f65d9fd32ed"
format_stamp: "Formatted at 2026-08-08 10:02:30 on dist-test-slave-gw5c"
server_key: "c28d3e269c3e37b0adf0e57dd9af6206"
server_key_iv: "c1167e4600f0b4c35e7ecac876d59391"
server_key_version: "encryptionkey@0"
I20260808 10:02:30.369915 26313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "fc6f2767afad409ebcaf9f65d9fd32ed"
format_stamp: "Formatted at 2026-08-08 10:02:30 on dist-test-slave-gw5c"
server_key: "c28d3e269c3e37b0adf0e57dd9af6206"
server_key_iv: "c1167e4600f0b4c35e7ecac876d59391"
server_key_version: "encryptionkey@0"
I20260808 10:02:30.371301 26313 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 10:02:30.372134 26344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:30.372329 26313 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:30.372447 26313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "fc6f2767afad409ebcaf9f65d9fd32ed"
format_stamp: "Formatted at 2026-08-08 10:02:30 on dist-test-slave-gw5c"
server_key: "c28d3e269c3e37b0adf0e57dd9af6206"
server_key_iv: "c1167e4600f0b4c35e7ecac876d59391"
server_key_version: "encryptionkey@0"
I20260808 10:02:30.372534 26313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:30.382493 26313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:30.384841 26313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:30.385070 26313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:30.389902 26313 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:45917
I20260808 10:02:30.389941 26416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:45917 every 8 connection(s)
I20260808 10:02:30.390353 26313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:30.391364 26417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:30.394057 26417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed: Bootstrap starting.
I20260808 10:02:30.394654 26417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:30.394937 26417 log.cc:824] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:30.395625 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 26313
I20260808 10:02:30.395756 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:30.395905 26417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed: No bootstrap required, opened a new log
I20260808 10:02:30.395961 24863 external_mini_cluster.cc:1428] Setting key e8a7140cb6141d9a87dacf57f385482c
I20260808 10:02:30.397779 26417 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc6f2767afad409ebcaf9f65d9fd32ed" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 45917 } }
I20260808 10:02:30.397955 26417 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:30.398023 26417 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6f2767afad409ebcaf9f65d9fd32ed, State: Initialized, Role: FOLLOWER
I20260808 10:02:30.398226 26417 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc6f2767afad409ebcaf9f65d9fd32ed" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 45917 } }
I20260808 10:02:30.398334 26417 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:30.398382 26417 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:30.398432 26417 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:30.399083 26417 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc6f2767afad409ebcaf9f65d9fd32ed" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 45917 } }
I20260808 10:02:30.399210 26417 leader_election.cc:302] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc6f2767afad409ebcaf9f65d9fd32ed; no voters:
I20260808 10:02:30.399436 26417 leader_election.cc:288] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:30.399472 26426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:30.399616 26426 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [term 1 LEADER]: Becoming Leader. State: Replica: fc6f2767afad409ebcaf9f65d9fd32ed, State: Running, Role: LEADER
I20260808 10:02:30.399734 26417 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:30.399762 26426 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc6f2767afad409ebcaf9f65d9fd32ed" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 45917 } }
I20260808 10:02:30.400200 26426 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc6f2767afad409ebcaf9f65d9fd32ed. Latest consensus state: current_term: 1 leader_uuid: "fc6f2767afad409ebcaf9f65d9fd32ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc6f2767afad409ebcaf9f65d9fd32ed" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 45917 } } }
I20260808 10:02:30.400343 26426 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:30.400331 26429 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc6f2767afad409ebcaf9f65d9fd32ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc6f2767afad409ebcaf9f65d9fd32ed" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 45917 } } }
I20260808 10:02:30.400489 26429 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:30.400631 26437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:30.401415 26437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:30.403266 26437 catalog_manager.cc:1347] Generated new cluster ID: fba945f2727647d4958a5a99e9e40226
I20260808 10:02:30.403270 26425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:30.396579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60049 (local address 127.24.71.254:45917)
0808 10:02:30.396806 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:30.396817 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:30.396863 (+ 46us) server_negotiation.cc:407] Connection header received
0808 10:02:30.397763 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:30.397772 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:30.397831 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:30.398004 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:30.398237 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:30.399766 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:30.400919 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:30.401534 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:30.402063 (+ 529us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:30.402521 (+ 458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:30.402525 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:30.402526 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:30.402736 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:30.402778 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:30.402793 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:30.402873 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:30.402972 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 10:02:30.403039 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":93,"threads_started":1}
I20260808 10:02:30.403327 26437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:30.408185 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:30.413136 26425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:30.409684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37659 (local address 127.24.71.254:45917)
0808 10:02:30.409725 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:30.409727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:30.409870 (+ 143us) server_negotiation.cc:407] Connection header received
0808 10:02:30.409955 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:30.409956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:30.409966 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:30.409995 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:30.410168 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:30.410863 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:30.411833 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:30.412111 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:30.412146 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:30.412901 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:30.412903 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:30.412903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:30.412908 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:30.412921 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:30.412925 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:30.412949 (+ 24us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:30.413036 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 10:02:30.413060 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 10:02:30.435573 26437 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:30.436174 26437 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:30.439764 26437 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc6f2767afad409ebcaf9f65d9fd32ed: Generated new TSK 0
I20260808 10:02:30.439972 26437 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:30.445477 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 26313
2026-08-08T10:02:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1561 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:30 dist-test-slave-gw5c krb5kdc[26465](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:30 dist-test-slave-gw5c krb5kdc[26465](info): set up 2 sockets
Aug 08 10:02:30 dist-test-slave-gw5c krb5kdc[26465](info): commencing operation
krb5kdc: starting...
W20260808 10:02:31.689019 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:31 dist-test-slave-gw5c krb5kdc[26465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:02:31.820657 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:38043
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:46089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:38043
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:31.905438 26484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:31.905704 26484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:31.905746 26484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:31.906935 26484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:31.907019 26484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:31.907043 26484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:31.907065 26484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:31.907094 26484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:31.908632 26484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:46089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:38043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:38043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:31.908917 26484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:31.909152 26484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:31.914347 26489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:31.914521 26484 server_base.cc:1034] running on GCE node
W20260808 10:02:31.914343 26491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:31.914340 26493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:31.914917 26484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:31.915213 26484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:31.916361 26484 hybrid_clock.cc:648] HybridClock initialized: now 1786183351916345 us; error 27 us; skew 500 ppm
Aug 08 10:02:31 dist-test-slave-gw5c krb5kdc[26465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183351, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:31.918874 26484 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:02:31.919363 26484 webserver.cc:460] Webserver started at http://127.24.71.254:43661/ using document root <none> and password file <none>
I20260808 10:02:31.919636 26484 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:31.919704 26484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:31.919865 26484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:31.920933 26484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "add5883672474d52b1970fb6224d00d5"
format_stamp: "Formatted at 2026-08-08 10:02:31 on dist-test-slave-gw5c"
server_key: "17f69baf389f48d4a9a46daffe27306c"
server_key_iv: "b7f582621118b863c52df84c77318e91"
server_key_version: "encryptionkey@0"
I20260808 10:02:31.921320 26484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "add5883672474d52b1970fb6224d00d5"
format_stamp: "Formatted at 2026-08-08 10:02:31 on dist-test-slave-gw5c"
server_key: "17f69baf389f48d4a9a46daffe27306c"
server_key_iv: "b7f582621118b863c52df84c77318e91"
server_key_version: "encryptionkey@0"
I20260808 10:02:31.922972 26484 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:02:31.923820 26502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:31.924023 26484 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:31.924121 26484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "add5883672474d52b1970fb6224d00d5"
format_stamp: "Formatted at 2026-08-08 10:02:31 on dist-test-slave-gw5c"
server_key: "17f69baf389f48d4a9a46daffe27306c"
server_key_iv: "b7f582621118b863c52df84c77318e91"
server_key_version: "encryptionkey@0"
I20260808 10:02:31.924211 26484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:31.927673 26484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:31.929522 26484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:31.929684 26484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:31.933928 26484 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:38043
I20260808 10:02:31.933974 26578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:38043 every 8 connection(s)
I20260808 10:02:31.934357 26484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:31.935497 26579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:31.936622 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 26484
I20260808 10:02:31.936741 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:31.936954 24863 external_mini_cluster.cc:1428] Setting key 3ddcb18512b562fe838e4785d40d1a46
I20260808 10:02:31.938396 26579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5: Bootstrap starting.
I20260808 10:02:31.939235 26579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:31.939620 26579 log.cc:824] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:31.939827 26583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:31.937561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60319 (local address 127.24.71.254:38043)
0808 10:02:31.937763 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:31.937772 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:31.937811 (+ 39us) server_negotiation.cc:407] Connection header received
0808 10:02:31.938291 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:31.938298 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:31.938325 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:31.938454 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:31.939318 (+ 864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:31.939321 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:31.939322 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:31.939327 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:31.939378 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:31.939430 (+ 52us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:31.939534 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:31.939566 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 10:02:31.939599 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":105,"threads_started":1}
I20260808 10:02:31.940500 26579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5: No bootstrap required, opened a new log
I20260808 10:02:31.940997 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:31.942790 26579 raft_consensus.cc:348] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "add5883672474d52b1970fb6224d00d5" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 38043 } }
I20260808 10:02:31.942982 26579 raft_consensus.cc:374] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 10:02:31.943042 26579 raft_consensus.cc:729] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: add5883672474d52b1970fb6224d00d5, State: Initialized, Role: FOLLOWER
I20260808 10:02:31.943172 26579 consensus_queue.cc:260] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "add5883672474d52b1970fb6224d00d5" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 38043 } }
I20260808 10:02:31.943275 26579 raft_consensus.cc:388] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 10:02:31.943320 26579 raft_consensus.cc:482] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 10:02:31.943380 26579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:31.943627 26583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:31.942431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32793 (local address 127.24.71.254:38043)
0808 10:02:31.942497 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:31.942499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:31.942610 (+ 111us) server_negotiation.cc:407] Connection header received
0808 10:02:31.942677 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:31.942677 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:31.942681 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:31.942726 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:31.943378 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:31.943379 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:31.943379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 10:02:31.943384 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:31.943426 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 10:02:31.943430 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:31.943464 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:31.943570 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 10:02:31.943583 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 10:02:31.944260 26579 raft_consensus.cc:504] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "add5883672474d52b1970fb6224d00d5" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 38043 } }
I20260808 10:02:31.944379 26579 leader_election.cc:302] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: add5883672474d52b1970fb6224d00d5; no voters:
I20260808 10:02:31.944554 26579 leader_election.cc:288] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 10:02:31.944579 26591 raft_consensus.cc:2781] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:31.944722 26591 raft_consensus.cc:686] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [term 1 LEADER]: Becoming Leader. State: Replica: add5883672474d52b1970fb6224d00d5, State: Running, Role: LEADER
I20260808 10:02:31.944829 26579 sys_catalog.cc:564] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:31.944887 26591 consensus_queue.cc:237] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "add5883672474d52b1970fb6224d00d5" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 38043 } }
I20260808 10:02:31.945298 26592 sys_catalog.cc:455] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "add5883672474d52b1970fb6224d00d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "add5883672474d52b1970fb6224d00d5" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 38043 } } }
I20260808 10:02:31.945302 26596 sys_catalog.cc:455] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader add5883672474d52b1970fb6224d00d5. Latest consensus state: current_term: 1 leader_uuid: "add5883672474d52b1970fb6224d00d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "add5883672474d52b1970fb6224d00d5" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 38043 } } }
I20260808 10:02:31.945482 26592 sys_catalog.cc:458] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:31.945492 26596 sys_catalog.cc:458] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5 [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:31.945734 26610 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:31.946354 26610 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:31.947885 26610 catalog_manager.cc:1347] Generated new cluster ID: c753d0940aed494db9ab5b8dcd877ceb
I20260808 10:02:31.947938 26610 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:31.957306 26610 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:31.957504 26610 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:31.964439 26610 catalog_manager.cc:5868] T 00000000000000000000000000000000 P add5883672474d52b1970fb6224d00d5: Generated new TSK 0
I20260808 10:02:31.964655 26610 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:31.973657 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 26484
2026-08-08T10:02:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1528 ms)
[----------] 18 tests from AuthTokenIssuingTest (28029 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:32 dist-test-slave-gw5c krb5kdc[26626](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:32 dist-test-slave-gw5c krb5kdc[26626](info): set up 2 sockets
Aug 08 10:02:32 dist-test-slave-gw5c krb5kdc[26626](info): commencing operation
krb5kdc: starting...
W20260808 10:02:33.227707 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:02:33.355710 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:42413
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:42413,127.24.71.253:33527,127.24.71.252:36111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:33.442647 26650 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 10:02:33.442919 26650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:33.442953 26650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:33.442998 26650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:33.444151 26650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:33.444222 26650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:33.444249 26650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:33.444271 26650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:33.444300 26650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:33.445833 26650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:42413,127.24.71.253:33527,127.24.71.252:36111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:42413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:33.446130 26650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:33.446377 26650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:33.451318 26657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:33.451500 26650 server_base.cc:1034] running on GCE node
W20260808 10:02:33.451318 26656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:33.451346 26659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:33.451885 26650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:33.452178 26650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:33.453341 26650 hybrid_clock.cc:648] HybridClock initialized: now 1786183353453324 us; error 48 us; skew 500 ppm
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:33.455875 26650 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:02:33.456300 26650 webserver.cc:460] Webserver started at http://127.24.71.254:37199/ using document root <none> and password file <none>
I20260808 10:02:33.456557 26650 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:33.456604 26650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:33.456693 26650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:33.457818 26650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "05c26e85a7e147dda57cbb4e51e8e06d"
format_stamp: "Formatted at 2026-08-08 10:02:33 on dist-test-slave-gw5c"
server_key: "f8b1508a1e255084271915168032e283"
server_key_iv: "2e71bff7ab5a9f1ef7ab335d0e5f99f4"
server_key_version: "encryptionkey@0"
I20260808 10:02:33.458176 26650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "05c26e85a7e147dda57cbb4e51e8e06d"
format_stamp: "Formatted at 2026-08-08 10:02:33 on dist-test-slave-gw5c"
server_key: "f8b1508a1e255084271915168032e283"
server_key_iv: "2e71bff7ab5a9f1ef7ab335d0e5f99f4"
server_key_version: "encryptionkey@0"
I20260808 10:02:33.459637 26650 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 10:02:33.460315 26669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:33.460520 26650 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:33.460633 26650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "05c26e85a7e147dda57cbb4e51e8e06d"
format_stamp: "Formatted at 2026-08-08 10:02:33 on dist-test-slave-gw5c"
server_key: "f8b1508a1e255084271915168032e283"
server_key_iv: "2e71bff7ab5a9f1ef7ab335d0e5f99f4"
server_key_version: "encryptionkey@0"
I20260808 10:02:33.460711 26650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:33.468444 26650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:33.470543 26650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:33.470711 26650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:33.474959 26650 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:42413
I20260808 10:02:33.475055 26751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:42413 every 8 connection(s)
I20260808 10:02:33.475481 26650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:33.476514 26752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:33.478148 26752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:33.481819 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 26650
I20260808 10:02:33.481945 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:33.482159 24863 external_mini_cluster.cc:1428] Setting key d29b7aa0340f7aae0d333f3caa18c8a9
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:02:33.488178 26760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.479092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54972 (local address 127.24.71.254:42413)
0808 10:02:33.479222 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.479226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.479267 (+ 41us) server_negotiation.cc:407] Connection header received
0808 10:02:33.479815 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.479817 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.479834 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.479914 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.480440 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.481243 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.482143 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.482506 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.482649 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.484853 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.484860 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.484861 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.484868 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.486473 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.486967 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.486970 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.486970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.487050 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.487317 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.487318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.487318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.487588 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.487655 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.487908 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.488010 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":72,"threads_started":1}
I20260808 10:02:33.488273 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.478886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:42413 (local address 127.0.0.1:54972)
0808 10:02:33.479097 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.479138 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:33.479684 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:33.479949 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:33.479951 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:33.480200 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:33.480359 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.480362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.481328 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.481329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.482070 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.482073 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.482628 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.482629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.482696 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.483294 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:33.483304 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:33.484758 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:33.486565 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.486573 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.486575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.486877 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.487123 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.487124 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.487124 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.487242 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.487664 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:33.487673 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:33.487760 (+ 87us) client_negotiation.cc:769] Sending connection context
0808 10:02:33.487890 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 10:02:33.488087 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":31,"thread_start_us":105,"threads_started":1}
I20260808 10:02:33.489192 26752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:33.489647 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.489500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:33527 (local address 127.0.0.1:56696)
0808 10:02:33.489555 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.489615 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:33527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 10:02:33.489818 26673 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.71.253:33527: connect: Connection refused (error 111)
I20260808 10:02:33.490335 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.490211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:33527 (local address 127.0.0.1:56702)
0808 10:02:33.490272 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.490304 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:33527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 10:02:33.490490 26752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.253:33527: Network error: Client connection negotiation failed: client connection to 127.24.71.253:33527: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.24.71.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.253.keytab.
Entry for principal kudu/127.24.71.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.253.keytab.
I20260808 10:02:33.508723 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.253:33527
--webserver_interface=127.24.71.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.253.keytab
--principal=kudu/127.24.71.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:42413,127.24.71.253:33527,127.24.71.252:36111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:02:33.539750 26752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } attempt: 1
I20260808 10:02:33.540315 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.540146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:33527 (local address 127.0.0.1:56706)
0808 10:02:33.540219 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.540274 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:33527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 10:02:33.540728 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.540622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:33527 (local address 127.0.0.1:56714)
0808 10:02:33.540681 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.540709 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:33527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 10:02:33.540831 26752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.253:33527: Network error: Client connection negotiation failed: client connection to 127.24.71.253:33527: connect: Connection refused (error 111)
W20260808 10:02:33.593806 26764 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 10:02:33.594026 26764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:33.594044 26764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:33.594065 26764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:33.595153 26764 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:33.595187 26764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:33.595201 26764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:33.595214 26764 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:33.595227 26764 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:33.596662 26764 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:42413,127.24.71.253:33527,127.24.71.252:36111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.253.keytab
--principal=kudu/127.24.71.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.253:33527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.71.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:33.596856 26764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:33.597031 26764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:33.601812 26772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:33.601750 26777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:33.601763 26773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:33.602010 26764 server_base.cc:1034] running on GCE node
I20260808 10:02:33.602272 26764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:33.602514 26764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:33.603674 26764 hybrid_clock.cc:648] HybridClock initialized: now 1786183353603652 us; error 36 us; skew 500 ppm
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:33.606257 26764 init.cc:377] Logged in from keytab as kudu/127.24.71.253@KRBTEST.COM (short username kudu)
I20260808 10:02:33.606720 26764 webserver.cc:460] Webserver started at http://127.24.71.253:40571/ using document root <none> and password file <none>
I20260808 10:02:33.606916 26764 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:33.606959 26764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:33.607048 26764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:33.608098 26764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/data/instance:
uuid: "7b7737150eaa44ddb462400d1a856cf7"
format_stamp: "Formatted at 2026-08-08 10:02:33 on dist-test-slave-gw5c"
server_key: "53a1a7cd9f9ac7cb52d9a76d96e4b009"
server_key_iv: "b4da83c3bb4219ff1cd34ec3863e5e81"
server_key_version: "encryptionkey@0"
I20260808 10:02:33.608414 26764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/wal/instance:
uuid: "7b7737150eaa44ddb462400d1a856cf7"
format_stamp: "Formatted at 2026-08-08 10:02:33 on dist-test-slave-gw5c"
server_key: "53a1a7cd9f9ac7cb52d9a76d96e4b009"
server_key_iv: "b4da83c3bb4219ff1cd34ec3863e5e81"
server_key_version: "encryptionkey@0"
I20260808 10:02:33.608989 26752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } attempt: 2
I20260808 10:02:33.609380 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.609246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:33527 (local address 127.0.0.1:56716)
0808 10:02:33.609310 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.609347 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:33527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 10:02:33.609807 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.609690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:33527 (local address 127.0.0.1:56730)
0808 10:02:33.609745 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.609778 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:33527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 10:02:33.609951 26752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.253:33527: Network error: Client connection negotiation failed: client connection to 127.24.71.253:33527: connect: Connection refused (error 111)
I20260808 10:02:33.610064 26764 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 10:02:33.610798 26784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:33.610965 26764 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:02:33.611066 26764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/wal
uuid: "7b7737150eaa44ddb462400d1a856cf7"
format_stamp: "Formatted at 2026-08-08 10:02:33 on dist-test-slave-gw5c"
server_key: "53a1a7cd9f9ac7cb52d9a76d96e4b009"
server_key_iv: "b4da83c3bb4219ff1cd34ec3863e5e81"
server_key_version: "encryptionkey@0"
I20260808 10:02:33.611158 26764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:33.630483 26764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:33.633124 26764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:33.633306 26764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:33.637789 26764 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.253:33527
I20260808 10:02:33.637871 26865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.253:33527 every 8 connection(s)
I20260808 10:02:33.638234 26764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/data/info.pb
I20260808 10:02:33.639266 26866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:33.640903 26866 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:33.644632 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 26764
I20260808 10:02:33.644755 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-1/wal/instance
I20260808 10:02:33.644968 24863 external_mini_cluster.cc:1428] Setting key 798b8de7b5b0ede178f38d47bcce9a23
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.253@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:02:33.650851 26760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.641656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54978 (local address 127.24.71.254:42413)
0808 10:02:33.641714 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.641716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.641941 (+ 225us) server_negotiation.cc:407] Connection header received
0808 10:02:33.642396 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.642397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.642409 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.642470 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.643048 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.643537 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.644678 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.644966 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.645048 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.647519 (+ 2471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.647521 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.647522 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.647532 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.649257 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.649739 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.649741 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.649742 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.649818 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.650107 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.650110 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.650110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.650246 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.650329 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.650644 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.650745 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 10:02:33.651022 26869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.641605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:42413 (local address 127.0.0.1:54978)
0808 10:02:33.641810 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.641856 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:33.642312 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:33.642523 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:33.642527 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:33.642778 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:33.642975 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.642980 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.643637 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.643638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.644590 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.644594 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.645072 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.645074 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.645243 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.645751 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:33.645762 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:33.647368 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:33.649384 (+ 2016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.649392 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.649394 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.649646 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.649894 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.649894 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.649895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.650000 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.650331 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:33.650364 (+ 33us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:33.650495 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 10:02:33.650608 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 10:02:33.650775 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":108,"threads_started":1}
I20260808 10:02:33.651750 26866 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.71.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.252@KRBTEST.COM" created.
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.253@KRBTEST.COM for kudu/127.24.71.253@KRBTEST.COM
I20260808 10:02:33.661469 26872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.652127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56746 (local address 127.24.71.253:33527)
0808 10:02:33.652321 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.652327 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.652353 (+ 26us) server_negotiation.cc:407] Connection header received
0808 10:02:33.652378 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.652380 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.652396 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.652492 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.652745 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.653895 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.654579 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.655099 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.655179 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.658210 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.658219 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.658219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.658227 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.660146 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.660512 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.660515 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.660516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.660573 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.660791 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.660792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.660792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.660964 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.661038 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.661218 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.661369 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":75,"server-negotiator.queue_time_us":155,"thread_start_us":102,"threads_started":1}
I20260808 10:02:33.661486 26869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.652058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:33527 (local address 127.0.0.1:56746)
0808 10:02:33.652145 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.652157 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:33.652206 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:33.652499 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:33.652500 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:33.652618 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:33.652669 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.652671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.653988 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.653989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.654492 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.654494 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.655200 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.655201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.655268 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.655733 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:33.655737 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:33.658123 (+ 2386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:33.660251 (+ 2128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.660252 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.660253 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.660421 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.660647 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.660648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.660648 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.660713 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.661044 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:33.661045 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:33.661098 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 10:02:33.661176 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 10:02:33.661299 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 10:02:33.662272 26866 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:33.662648 26869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.662505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:36111 (local address 127.0.0.1:36928)
0808 10:02:33.662562 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.662620 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 10:02:33.662806 26787 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
I20260808 10:02:33.663291 26869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.663206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:36111 (local address 127.0.0.1:36942)
0808 10:02:33.663249 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.663274 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 10:02:33.663458 26866 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:36111: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.252.keytab.
Entry for principal kudu/127.24.71.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.252.keytab.
I20260808 10:02:33.675012 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.252:36111
--webserver_interface=127.24.71.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.252.keytab
--principal=kudu/127.24.71.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:35839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:42413,127.24.71.253:33527,127.24.71.252:36111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:02:33.701107 26752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } attempt: 3
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for kudu/127.24.71.253@KRBTEST.COM
I20260808 10:02:33.708621 26872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.701569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56756 (local address 127.24.71.253:33527)
0808 10:02:33.701638 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.701640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.701654 (+ 14us) server_negotiation.cc:407] Connection header received
0808 10:02:33.701728 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.701729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.701741 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.701809 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.702162 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.702734 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.703491 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.703737 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.703839 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.705980 (+ 2141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.705982 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.705982 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.705991 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.707430 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.707790 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.707792 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.707792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.707863 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.708060 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.708061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.708062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.708181 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.708256 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.708445 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.708524 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 10:02:33.708621 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.701498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:33527 (local address 127.0.0.1:56756)
0808 10:02:33.701566 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.701598 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:33.701659 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:33.701828 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:33.701829 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:33.702005 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:33.702079 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.702081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.702825 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.702827 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.703357 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.703358 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.703832 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.703833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.703917 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.704438 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:33.704443 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:33.705894 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:33.707517 (+ 1623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.707518 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.707519 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.707705 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.707931 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.707932 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.707932 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.707997 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.708260 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:33.708261 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:33.708310 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 10:02:33.708405 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 10:02:33.708515 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 10:02:33.709227 26752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:33.709586 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.709480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:36111 (local address 127.0.0.1:36956)
0808 10:02:33.709530 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.709563 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 10:02:33.709892 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.709836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:36111 (local address 127.0.0.1:36958)
0808 10:02:33.709858 (+ 22us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.709878 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260808 10:02:33.709992 26752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:36111: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
I20260808 10:02:33.712679 26866 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } attempt: 1
I20260808 10:02:33.713060 26869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.712948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:36111 (local address 127.0.0.1:36962)
0808 10:02:33.713008 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.713038 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 10:02:33.713392 26869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.713294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:36111 (local address 127.0.0.1:36972)
0808 10:02:33.713350 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.713375 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 10:02:33.713503 26866 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:36111: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
I20260808 10:02:33.741132 26752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } attempt: 1
I20260808 10:02:33.741708 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.741515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:36111 (local address 127.0.0.1:36988)
0808 10:02:33.741600 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.741659 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 10:02:33.742125 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.742018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:36111 (local address 127.0.0.1:37004)
0808 10:02:33.742066 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.742099 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 10:02:33.742252 26752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:36111: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
W20260808 10:02:33.761880 26877 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 10:02:33.762099 26877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:33.762116 26877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:33.762166 26877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:33.763840 26877 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:33.763891 26877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:33.763906 26877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:33.763918 26877 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:33.763960 26877 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:33.765508 26877 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:35839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:42413,127.24.71.253:33527,127.24.71.252:36111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.252.keytab
--principal=kudu/127.24.71.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.252:36111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.71.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:33.765784 26877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:33.766038 26877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:33.770977 26886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:33.771005 26889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:33.770993 26892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:33.771268 26877 server_base.cc:1034] running on GCE node
I20260808 10:02:33.771557 26877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:33.771852 26877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:33.773027 26877 hybrid_clock.cc:648] HybridClock initialized: now 1786183353773022 us; error 36 us; skew 500 ppm
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:33.775657 26877 init.cc:377] Logged in from keytab as kudu/127.24.71.252@KRBTEST.COM (short username kudu)
I20260808 10:02:33.776108 26877 webserver.cc:460] Webserver started at http://127.24.71.252:43487/ using document root <none> and password file <none>
I20260808 10:02:33.776378 26877 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:33.776455 26877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:33.776602 26877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:33.777724 26877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/data/instance:
uuid: "e8f25727827b45f8b6818db3fffe4a90"
format_stamp: "Formatted at 2026-08-08 10:02:33 on dist-test-slave-gw5c"
server_key: "e68d46ab8de39533b6a15650acd04895"
server_key_iv: "8bb707ec8ee045a29b0d87df8ddfaaf4"
server_key_version: "encryptionkey@0"
I20260808 10:02:33.778092 26877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/wal/instance:
uuid: "e8f25727827b45f8b6818db3fffe4a90"
format_stamp: "Formatted at 2026-08-08 10:02:33 on dist-test-slave-gw5c"
server_key: "e68d46ab8de39533b6a15650acd04895"
server_key_iv: "8bb707ec8ee045a29b0d87df8ddfaaf4"
server_key_version: "encryptionkey@0"
I20260808 10:02:33.779565 26877 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 10:02:33.780391 26905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:33.780611 26877 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 10:02:33.780714 26877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/wal
uuid: "e8f25727827b45f8b6818db3fffe4a90"
format_stamp: "Formatted at 2026-08-08 10:02:33 on dist-test-slave-gw5c"
server_key: "e68d46ab8de39533b6a15650acd04895"
server_key_iv: "8bb707ec8ee045a29b0d87df8ddfaaf4"
server_key_version: "encryptionkey@0"
I20260808 10:02:33.780797 26877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:33.781638 26866 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } attempt: 2
I20260808 10:02:33.782086 26869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.781942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:36111 (local address 127.0.0.1:37016)
0808 10:02:33.782007 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.782045 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 10:02:33.782485 26869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.782374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:36111 (local address 127.0.0.1:37026)
0808 10:02:33.782429 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.782464 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 10:02:33.782579 26866 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:36111: Network error: Client connection negotiation failed: client connection to 127.24.71.252:36111: connect: Connection refused (error 111)
I20260808 10:02:33.803107 26877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:33.805269 26877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:33.805444 26877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:33.809991 26877 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.252:36111
I20260808 10:02:33.810034 26995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.252:36111 every 8 connection(s)
I20260808 10:02:33.810444 26877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/data/info.pb
I20260808 10:02:33.810896 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 26877
I20260808 10:02:33.811040 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786183068256695-24863-0/minicluster-data/master-2/wal/instance
I20260808 10:02:33.811223 24863 external_mini_cluster.cc:1428] Setting key cca76c81a7c9bf199c8b7c7a86fa62bf
I20260808 10:02:33.811746 26996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:33.814227 26996 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:33.817431 26752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } attempt: 2
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.252@KRBTEST.COM
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.252@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for kudu/127.24.71.252@KRBTEST.COM
I20260808 10:02:33.822954 27002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.811813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37038 (local address 127.24.71.252:36111)
0808 10:02:33.812013 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.812022 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.812048 (+ 26us) server_negotiation.cc:407] Connection header received
0808 10:02:33.812494 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.812500 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.812546 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.812660 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.813490 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.814487 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.815676 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.816230 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.816348 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.819290 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.819299 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.819300 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.819307 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.821204 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.821662 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.821666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.821666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.821775 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.822017 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.822018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.822019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.822326 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.822483 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.822585 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.822684 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":112,"threads_started":1}
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:02:33.829319 26760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.814950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54980 (local address 127.24.71.254:42413)
0808 10:02:33.815019 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.815021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.815156 (+ 135us) server_negotiation.cc:407] Connection header received
0808 10:02:33.815218 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.815219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.815228 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.815276 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.815850 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.816544 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.817755 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.818076 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.818122 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.821732 (+ 3610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.821734 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.821734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.821741 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.827798 (+ 6057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.828380 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.828381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.828382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.828445 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.828667 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.828668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.828668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.828818 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.828913 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.829128 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.829216 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 10:02:33.829339 27003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.814853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:42413 (local address 127.0.0.1:54980)
0808 10:02:33.815042 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.815085 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:33.815157 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:33.815292 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:33.815294 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:33.815670 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:33.815775 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.815777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.816641 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.816642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.817644 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.817647 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.818246 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.818247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.818320 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.818872 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:33.818882 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:33.821668 (+ 2786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:33.827891 (+ 6223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.827901 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.827903 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.828291 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.828521 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.828522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.828523 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.828589 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.828942 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:33.828951 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:33.829006 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 10:02:33.829100 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 10:02:33.829216 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":105,"threads_started":1}
I20260808 10:02:33.829795 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.817705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:36111 (local address 127.0.0.1:37042)
0808 10:02:33.817749 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.817762 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:33.817799 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:33.818013 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:33.818014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:33.818172 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:33.818206 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.818208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.819015 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.819016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.819750 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.819754 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.820288 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.820289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.820356 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.820676 (+ 320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:33.820680 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:33.821876 (+ 1196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:33.828476 (+ 6600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.828477 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.828478 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.828704 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.828951 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.828952 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.828953 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.829019 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.829323 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:33.829324 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:33.829370 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 10:02:33.829420 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 10:02:33.829644 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 10:02:33.829934 26996 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:33.830711 27004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.817744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37042 (local address 127.24.71.252:36111)
0808 10:02:33.817891 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.817893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.817899 (+ 6us) server_negotiation.cc:407] Connection header received
0808 10:02:33.817917 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.817917 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.817924 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.818005 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.818281 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.818898 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.819849 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.820178 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.820279 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.821958 (+ 1679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.821959 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.821959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.821967 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.828372 (+ 6405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.828794 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.828794 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.828795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.828857 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.829097 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.829098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.829099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.829234 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.830016 (+ 782us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.830063 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.830539 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":97,"threads_started":1}
I20260808 10:02:33.832443 26752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d: Bootstrap starting.
I20260808 10:02:33.832656 27006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.824023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54996 (local address 127.24.71.254:42413)
0808 10:02:33.824182 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.824183 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.824189 (+ 6us) server_negotiation.cc:407] Connection header received
0808 10:02:33.824204 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.824204 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.824212 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.824262 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.824703 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.825453 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.826148 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.826440 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.826536 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.829333 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.829334 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.829334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.829341 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.831248 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.831698 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.831699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.831699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.831761 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.831981 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.831981 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.831982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.832094 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.832253 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.832318 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.832406 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":85,"threads_started":1}
I20260808 10:02:33.833379 26752 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:33.833737 26752 log.cc:824] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d: Log is configured to *not* fsync() on all Append() calls
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.252@KRBTEST.COM for kudu/127.24.71.253@KRBTEST.COM
I20260808 10:02:33.834825 26752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d: No bootstrap required, opened a new log
I20260808 10:02:33.836807 26752 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } }
I20260808 10:02:33.836930 26752 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05c26e85a7e147dda57cbb4e51e8e06d, State: Initialized, Role: FOLLOWER
I20260808 10:02:33.837031 26752 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } }
I20260808 10:02:33.837376 26752 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:33.837344 27012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } } }
I20260808 10:02:33.837827 27012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:02:33.838754 27003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.830202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:33527 (local address 127.0.0.1:56768)
0808 10:02:33.830337 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.830346 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:33.830396 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:33.830575 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:33.830576 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:33.830713 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:33.830794 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.830796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.831677 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.831678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.832433 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.832436 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.832980 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.832981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.833131 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.833580 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:33.833585 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:33.834984 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:33.837510 (+ 2526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.837511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.837511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.837734 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.838004 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.838006 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.838006 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.838082 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.838391 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:33.838392 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:33.838441 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 10:02:33.838516 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 10:02:33.838634 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.253@KRBTEST.COM
W20260808 10:02:33.839313 27033 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 10:02:33.839362 27033 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 10:02:33.839458 26872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.830289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56768 (local address 127.24.71.253:33527)
0808 10:02:33.830345 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.830347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.830379 (+ 32us) server_negotiation.cc:407] Connection header received
0808 10:02:33.830458 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.830459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.830471 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.830522 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.830913 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.831591 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.832572 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.832913 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.832982 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.835075 (+ 2093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.835077 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.835077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.835084 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.837426 (+ 2342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.837822 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.837823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.837824 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.837896 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.838164 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.838165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.838165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.838300 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.838360 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.839216 (+ 856us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.839308 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 10:02:33.839807 26996 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:33.840580 26650 master_runner.cc:186] Error getting master registration for 127.24.71.253:33527: OK, instance_id { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" instance_seqno: 1786183353636578 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 10:02:33.842957 26650 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 10:02:33.843660 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.833403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56774 (local address 127.24.71.253:33527)
0808 10:02:33.833610 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.833613 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.833621 (+ 8us) server_negotiation.cc:407] Connection header received
0808 10:02:33.833641 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.833642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.833654 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.833729 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.834344 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.835432 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.836133 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.836443 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.836517 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.839935 (+ 3418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.839936 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.839936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.839944 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.841754 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.842156 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.842157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.842158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.842217 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.842454 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.842455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.842455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.842580 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.843359 (+ 779us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.843442 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.843526 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":126,"threads_started":1}
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.252@KRBTEST.COM for kudu/127.24.71.252@KRBTEST.COM
I20260808 10:02:33.845069 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:33.846120 26708 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "05c26e85a7e147dda57cbb4e51e8e06d"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54996
I20260808 10:02:33.846257 26708 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 10:02:33.846311 26708 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:33.847035 26708 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } }
I20260808 10:02:33.847259 26708 leader_election.cc:288] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [CANDIDATE]: Term 1 election: Requested vote from peers 7b7737150eaa44ddb462400d1a856cf7 (127.24.71.253:33527), e8f25727827b45f8b6818db3fffe4a90 (127.24.71.252:36111)
I20260808 10:02:33.847292 27003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.840068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:36111 (local address 127.0.0.1:37058)
0808 10:02:33.840103 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.840113 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:33.840152 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:33.840312 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:33.840313 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:33.840474 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:33.840510 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.840512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.841382 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.841383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.842112 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.842115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.842623 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.842623 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.842664 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.843070 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:33.843075 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:33.844485 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:33.846321 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.846322 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.846322 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.846533 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.846715 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.846715 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.846716 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.846763 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.847015 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:33.847016 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:33.847050 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 10:02:33.847107 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 10:02:33.847200 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 10:02:33.847606 27004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.840121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37058 (local address 127.24.71.252:36111)
0808 10:02:33.840213 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.840215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.840221 (+ 6us) server_negotiation.cc:407] Connection header received
0808 10:02:33.840236 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.840237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.840245 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.840282 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.840582 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.841291 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.842199 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.842521 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.842579 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.844554 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.844555 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.844556 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.844563 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.846232 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.846605 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.846606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.846606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.846654 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.846825 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.846826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.846826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.846940 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.846995 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.847443 (+ 448us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.847526 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 10:02:33.849267 26996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90: Bootstrap starting.
I20260808 10:02:33.849989 26996 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:33.850296 26996 log.cc:824] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:33.857059 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.848634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56780 (local address 127.24.71.253:33527)
0808 10:02:33.848686 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.848687 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.848878 (+ 191us) server_negotiation.cc:407] Connection header received
0808 10:02:33.848985 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.848986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.849000 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.849030 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.849849 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.850579 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.851670 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.851981 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.852025 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.853639 (+ 1614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.853640 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.853641 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.853647 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.855692 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.856088 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.856089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.856090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.856147 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.856341 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.856342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.856343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.856506 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.856592 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.856881 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.856960 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 10:02:33.858645 27006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.848633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55012 (local address 127.24.71.254:42413)
0808 10:02:33.848679 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.848681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.849926 (+ 1245us) server_negotiation.cc:407] Connection header received
0808 10:02:33.850027 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.850028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.850040 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.850072 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.850701 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.852000 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.853036 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.853388 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.853439 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.855144 (+ 1705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.855145 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.855146 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.855154 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.856927 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.857734 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.857735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.857735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.857799 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.858014 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.858015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.858015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.858147 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.858227 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.858471 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.858557 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 10:02:33.858669 26996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90: No bootstrap required, opened a new log
I20260808 10:02:33.860677 27004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.848947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37072 (local address 127.24.71.252:36111)
0808 10:02:33.848982 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.848984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.849249 (+ 265us) server_negotiation.cc:407] Connection header received
0808 10:02:33.849379 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.849379 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.849389 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.849449 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.851010 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.851793 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.853731 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.854044 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.854087 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.857602 (+ 3515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.857603 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.857603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.857611 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.859350 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.859834 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.859835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.859835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.859902 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.860110 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.860111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.860112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.860250 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.860368 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.860493 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.860567 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 10:02:33.861161 26996 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } }
I20260808 10:02:33.861332 26996 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f25727827b45f8b6818db3fffe4a90, State: Initialized, Role: FOLLOWER
I20260808 10:02:33.861423 26996 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } }
I20260808 10:02:33.861719 27050 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } } }
I20260808 10:02:33.861775 26996 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:33.861805 27050 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:02:33.861847 26948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8f25727827b45f8b6818db3fffe4a90"
I20260808 10:02:33.861940 26948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:33.863492 26948 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05c26e85a7e147dda57cbb4e51e8e06d in term 1.
I20260808 10:02:33.863742 26673 leader_election.cc:302] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05c26e85a7e147dda57cbb4e51e8e06d, e8f25727827b45f8b6818db3fffe4a90; no voters:
I20260808 10:02:33.863911 27012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:33.864140 27012 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [term 1 LEADER]: Becoming Leader. State: Replica: 05c26e85a7e147dda57cbb4e51e8e06d, State: Running, Role: LEADER
I20260808 10:02:33.864246 27012 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } }
I20260808 10:02:33.864970 27072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05c26e85a7e147dda57cbb4e51e8e06d. Latest consensus state: current_term: 1 leader_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } } }
I20260808 10:02:33.865118 27072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:33.865491 27075 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:33.865733 27075 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:33.867508 26948 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90 [term 1 FOLLOWER]: Refusing update from remote peer 05c26e85a7e147dda57cbb4e51e8e06d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:02:33.867842 27072 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:02:33.866667 26877 master_runner.cc:186] Error getting master registration for 127.24.71.253:33527: OK, instance_id { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" instance_seqno: 1786183353636578 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 10:02:33.869179 26877 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 10:02:33.869977 27050 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05c26e85a7e147dda57cbb4e51e8e06d. Latest consensus state: current_term: 1 leader_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } } }
I20260808 10:02:33.870066 27050 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:02:33.870779 27012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } } }
I20260808 10:02:33.870869 27012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:33.871028 27050 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } } }
I20260808 10:02:33.871117 27050 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:02:33.871460 27075 catalog_manager.cc:1347] Generated new cluster ID: bd533f74d2094715b6bedcb03726c145
I20260808 10:02:33.871521 27075 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:33.873714 26866 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } attempt: 3
W20260808 10:02:33.875874 27074 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 10:02:33.875923 27074 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 08 10:02:33 dist-test-slave-gw5c krb5kdc[26626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.253@KRBTEST.COM for kudu/127.24.71.252@KRBTEST.COM
I20260808 10:02:33.882187 26869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.873978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:36111 (local address 127.0.0.1:37086)
0808 10:02:33.874031 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:33.874044 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:33.874089 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:33.874221 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:33.874222 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:33.874395 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:33.874443 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.874445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.875352 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.875354 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.876174 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:33.876177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.876635 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.876636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:33.876697 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.877292 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:33.877298 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:33.878915 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:33.881038 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.881040 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.881040 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.881282 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.881506 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:33.881507 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:33.881507 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:33.881570 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:33.881836 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:33.881837 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:33.881900 (+ 63us) client_negotiation.cc:769] Sending connection context
0808 10:02:33.881971 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 10:02:33.882078 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260808 10:02:33.882804 27004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:33.874067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37086 (local address 127.24.71.252:36111)
0808 10:02:33.874104 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.874106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.874114 (+ 8us) server_negotiation.cc:407] Connection header received
0808 10:02:33.874137 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.874138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.874149 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.874205 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.874531 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.875270 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.876269 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:33.876556 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:33.876615 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:33.879028 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:33.879029 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:33.879030 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:33.879038 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:33.880938 (+ 1900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.881362 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.881363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.881364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.881448 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:33.881640 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:33.881641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:33.881642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:33.881780 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:33.881845 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:33.882633 (+ 788us) server_negotiation.cc:299] Negotiation successful
0808 10:02:33.882719 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 10:02:33.884527 26866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7: Bootstrap starting.
I20260808 10:02:33.885377 26866 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:33.885697 26866 log.cc:824] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:33.899435 27075 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:33.900161 26866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7: No bootstrap required, opened a new log
I20260808 10:02:33.900295 27075 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:33.902375 26866 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } }
I20260808 10:02:33.902534 26866 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b7737150eaa44ddb462400d1a856cf7, State: Initialized, Role: FOLLOWER
I20260808 10:02:33.902623 26866 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } }
I20260808 10:02:33.902958 26866 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:33.903036 26825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7b7737150eaa44ddb462400d1a856cf7"
I20260808 10:02:33.903156 26825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:33.904608 26825 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05c26e85a7e147dda57cbb4e51e8e06d in term 1.
I20260808 10:02:33.905092 26821 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7 [term 1 FOLLOWER]: Refusing update from remote peer 05c26e85a7e147dda57cbb4e51e8e06d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:02:33.905580 27072 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:02:33.907024 27075 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d: Generated new TSK 0
I20260808 10:02:33.907291 27075 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 10:02:33.907935 27112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05c26e85a7e147dda57cbb4e51e8e06d. Latest consensus state: current_term: 1 leader_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } } }
I20260808 10:02:33.908149 27091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } } }
I20260808 10:02:33.908324 27091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:02:33.908389 27091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } } }
I20260808 10:02:33.908437 27091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:02:33.908640 27112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:02:33.912819 27110 mvcc.cc:205] Tried to move back new op lower bound from 7316207017588944896 to 7316207017428762624. Current Snapshot: MvccSnapshot[applied={T|T < 7316207017438154752}]
W20260808 10:02:33.919202 27113 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 10:02:33.919375 27113 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260808 10:02:33.932529 27007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:33.930791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56796 (local address 127.24.71.253:33527)
0808 10:02:33.930860 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.930863 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.931789 (+ 926us) server_negotiation.cc:407] Connection header received
0808 10:02:33.931901 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.931903 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.931926 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.931958 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.932448 (+ 490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56796: BlockingRecv error: recv got EOF from 127.0.0.1:56796 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260808 10:02:33.933514 27004 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:33.931163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37102 (local address 127.24.71.252:36111)
0808 10:02:33.931208 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.931210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.932984 (+ 1774us) server_negotiation.cc:407] Connection header received
0808 10:02:33.933084 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.933085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.933097 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.933127 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.933450 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37102: BlockingRecv error: recv got EOF from 127.0.0.1:37102 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 10:02:33.934536 27006 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:33.931537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55028 (local address 127.24.71.254:42413)
0808 10:02:33.931592 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.931595 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.933866 (+ 2271us) server_negotiation.cc:407] Connection header received
0808 10:02:33.934038 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.934040 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.934054 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.934084 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.934476 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55028: BlockingRecv error: recv got EOF from 127.0.0.1:55028 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260808 10:02:33.937378 27007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:33.936447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56800 (local address 127.24.71.253:33527)
0808 10:02:33.936484 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.936486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.936747 (+ 261us) server_negotiation.cc:407] Connection header received
0808 10:02:33.936858 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.936859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.936879 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.936923 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.937323 (+ 400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56800: BlockingRecv error: recv got EOF from 127.0.0.1:56800 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 10:02:33.940791 27007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:33.939897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56806 (local address 127.24.71.253:33527)
0808 10:02:33.939946 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.939948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.940220 (+ 272us) server_negotiation.cc:407] Connection header received
0808 10:02:33.940321 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.940322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.940335 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.940367 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.940738 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56806: BlockingRecv error: recv got EOF from 127.0.0.1:56806 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260808 10:02:33.944972 27007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:33.944126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56810 (local address 127.24.71.253:33527)
0808 10:02:33.944165 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.944167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.944421 (+ 254us) server_negotiation.cc:407] Connection header received
0808 10:02:33.944524 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.944524 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.944538 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.944568 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.944902 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56810: BlockingRecv error: recv got EOF from 127.0.0.1:56810 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 10:02:33.951212 27007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:33.950323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56822 (local address 127.24.71.253:33527)
0808 10:02:33.950363 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.950366 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.950631 (+ 265us) server_negotiation.cc:407] Connection header received
0808 10:02:33.950737 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.950738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.950751 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.950783 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.951156 (+ 373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56822: BlockingRecv error: recv got EOF from 127.0.0.1:56822 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 10:02:33.961728 27007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:33.960715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56834 (local address 127.24.71.253:33527)
0808 10:02:33.960759 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.960761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.961065 (+ 304us) server_negotiation.cc:407] Connection header received
0808 10:02:33.961176 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.961177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.961190 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.961222 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.961667 (+ 445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56834: BlockingRecv error: recv got EOF from 127.0.0.1:56834 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 10:02:33.980490 27007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:33.979347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56846 (local address 127.24.71.253:33527)
0808 10:02:33.979466 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:33.979468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:33.979802 (+ 334us) server_negotiation.cc:407] Connection header received
0808 10:02:33.979934 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:33.979936 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:33.979951 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:33.979983 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:33.980425 (+ 442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56846: BlockingRecv error: recv got EOF from 127.0.0.1:56846 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 10:02:34.015360 27007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:34.014225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56848 (local address 127.24.71.253:33527)
0808 10:02:34.014277 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:34.014279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:34.014606 (+ 327us) server_negotiation.cc:407] Connection header received
0808 10:02:34.014724 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:34.014725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:34.014738 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:34.014771 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:34.015287 (+ 516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56848: BlockingRecv error: recv got EOF from 127.0.0.1:56848 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 10:02:34.081799 27007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:34.081039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56856 (local address 127.24.71.253:33527)
0808 10:02:34.081109 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:34.081112 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:34.081153 (+ 41us) server_negotiation.cc:407] Connection header received
0808 10:02:34.081258 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:34.081259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:34.081271 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:34.081351 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:34.081714 (+ 363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56856: BlockingRecv error: recv got EOF from 127.0.0.1:56856 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 10:02:34.212076 27007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:34.211208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56870 (local address 127.24.71.253:33527)
0808 10:02:34.211297 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:34.211299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:34.211403 (+ 104us) server_negotiation.cc:407] Connection header received
0808 10:02:34.211536 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:34.211537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:34.211549 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:34.211625 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:34.211999 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56870: BlockingRecv error: recv got EOF from 127.0.0.1:56870 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 10:02:34.291848 27092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05c26e85a7e147dda57cbb4e51e8e06d" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 42413 } } peers { permanent_uuid: "7b7737150eaa44ddb462400d1a856cf7" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 33527 } } peers { permanent_uuid: "e8f25727827b45f8b6818db3fffe4a90" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 36111 } } }
I20260808 10:02:34.291994 27092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05c26e85a7e147dda57cbb4e51e8e06d [sys.catalog]: This master's current role is: LEADER
W20260808 10:02:34.475131 27007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:34.473065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44098 (local address 127.24.71.253:33527)
0808 10:02:34.473124 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:34.473126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:34.474518 (+ 1392us) server_negotiation.cc:407] Connection header received
0808 10:02:34.474557 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:34.474559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:34.474573 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:34.474642 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:34.475058 (+ 416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44098: BlockingRecv error: recv got EOF from 127.0.0.1:44098 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 10:02:34.876406 27074 catalog_manager.cc:1259] Loaded cluster ID: bd533f74d2094715b6bedcb03726c145
I20260808 10:02:34.876492 27074 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90: loading cluster ID for follower catalog manager: success
I20260808 10:02:34.877327 27074 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90: acquiring CA information for follower catalog manager: success
I20260808 10:02:34.877652 27074 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e8f25727827b45f8b6818db3fffe4a90: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 10:02:34.919939 27113 catalog_manager.cc:1259] Loaded cluster ID: bd533f74d2094715b6bedcb03726c145
I20260808 10:02:34.920055 27113 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7: loading cluster ID for follower catalog manager: success
I20260808 10:02:34.920904 27113 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7: acquiring CA information for follower catalog manager: success
I20260808 10:02:34.921245 27113 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7b7737150eaa44ddb462400d1a856cf7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 10:02:34.991365 27217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:34.988810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44108 (local address 127.24.71.253:33527)
0808 10:02:34.988957 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:34.988959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:34.988971 (+ 12us) server_negotiation.cc:407] Connection header received
0808 10:02:34.989001 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:34.989002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:34.989057 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:34.989131 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:02:34.989309 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:34.989800 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:34.990646 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:34.990833 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:34.990882 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:34.991033 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:34.991141 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:34.991199 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:34.991281 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 10:02:34.991298 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260808 10:02:34.996079 27224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:34.993418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40062 (local address 127.24.71.252:36111)
0808 10:02:34.993545 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:34.993547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:34.993556 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:02:34.993645 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:34.993645 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:34.993682 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:34.993771 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:02:34.993913 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:34.994401 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:34.995125 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:34.995396 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:34.995486 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:34.995710 (+ 224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:34.995821 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:34.995926 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:34.995967 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 10:02:34.995987 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":55,"threads_started":1}
I20260808 10:02:35.000669 27217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:34.997883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44124 (local address 127.24.71.253:33527)
0808 10:02:34.997928 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:34.997930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:34.998021 (+ 91us) server_negotiation.cc:407] Connection header received
0808 10:02:34.998109 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:34.998110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:34.998122 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:34.998166 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:02:34.998330 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:34.998903 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:34.999841 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:35.000143 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:35.000181 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:35.000365 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:35.000401 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:35.000467 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:35.000531 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 10:02:35.000554 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 10:02:35.001164 27224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:34.998149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40072 (local address 127.24.71.252:36111)
0808 10:02:34.998189 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:34.998191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:34.998294 (+ 103us) server_negotiation.cc:407] Connection header received
0808 10:02:34.998373 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:34.998374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:34.998385 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:34.998461 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:02:34.998558 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:34.999246 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:35.000167 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:35.000412 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:35.000479 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:35.000754 (+ 275us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:35.000791 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:35.000843 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:35.001069 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 10:02:35.001094 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 10:02:35.001483 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:34.997955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34726 (local address 127.24.71.254:42413)
0808 10:02:34.998065 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:34.998068 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:34.998077 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:02:34.998126 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:34.998127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:34.998181 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:34.998286 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:02:34.998417 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:34.999227 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:35.000274 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:35.000598 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:35.000659 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:35.001026 (+ 367us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:35.001123 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:35.001202 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:35.001376 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 10:02:35.001405 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":54,"threads_started":1}
I20260808 10:02:35.003299 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 26650
I20260808 10:02:35.019685 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 26764
I20260808 10:02:35.032152 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 26877
2026-08-08T10:02:35Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3055 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 10:02:35 dist-test-slave-gw5c krb5kdc[27245](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 10:02:35 dist-test-slave-gw5c krb5kdc[27245](info): set up 2 sockets
Aug 08 10:02:35 dist-test-slave-gw5c krb5kdc[27245](info): commencing operation
krb5kdc: starting...
W20260808 10:02:36.289346 24863 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/test-user.keytab.
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T10:02:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T10:02:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.71.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
Entry for principal kudu/127.24.71.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab.
I20260808 10:02:36.419154 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:41229
--webserver_interface=127.24.71.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:45289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:41229,127.24.71.253:42457,127.24.71.252:35525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 10:02:36.502666 27264 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 10:02:36.502945 27264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:36.502977 27264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:36.503022 27264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:36.504194 27264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:36.504273 27264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:36.504298 27264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:36.504319 27264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:36.504357 27264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:36.505903 27264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:45289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:41229,127.24.71.253:42457,127.24.71.252:35525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.254.keytab
--principal=kudu/127.24.71.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.254:41229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.71.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:36.506220 27264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:36.506472 27264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:36.511343 27272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:36.511350 27271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:36.511370 27275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:36.511662 27264 server_base.cc:1034] running on GCE node
I20260808 10:02:36.511955 27264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:36.512243 27264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:36.513417 27264 hybrid_clock.cc:648] HybridClock initialized: now 1786183356513389 us; error 37 us; skew 500 ppm
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:36.516088 27264 init.cc:377] Logged in from keytab as kudu/127.24.71.254@KRBTEST.COM (short username kudu)
I20260808 10:02:36.516480 27264 webserver.cc:460] Webserver started at http://127.24.71.254:40229/ using document root <none> and password file <none>
I20260808 10:02:36.516673 27264 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:36.516713 27264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:36.516810 27264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:36.517850 27264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/data/instance:
uuid: "99f22521fe21434d8b537c4c609ee4ad"
format_stamp: "Formatted at 2026-08-08 10:02:36 on dist-test-slave-gw5c"
server_key: "587d27bacb3296ab20c9dd39e76adbda"
server_key_iv: "cea036468f6e6433e217a1dd541d1152"
server_key_version: "encryptionkey@0"
I20260808 10:02:36.518163 27264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/wal/instance:
uuid: "99f22521fe21434d8b537c4c609ee4ad"
format_stamp: "Formatted at 2026-08-08 10:02:36 on dist-test-slave-gw5c"
server_key: "587d27bacb3296ab20c9dd39e76adbda"
server_key_iv: "cea036468f6e6433e217a1dd541d1152"
server_key_version: "encryptionkey@0"
I20260808 10:02:36.519533 27264 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 10:02:36.520253 27283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:36.520431 27264 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:02:36.520519 27264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/wal
uuid: "99f22521fe21434d8b537c4c609ee4ad"
format_stamp: "Formatted at 2026-08-08 10:02:36 on dist-test-slave-gw5c"
server_key: "587d27bacb3296ab20c9dd39e76adbda"
server_key_iv: "cea036468f6e6433e217a1dd541d1152"
server_key_version: "encryptionkey@0"
I20260808 10:02:36.520579 27264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:36.535213 27264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:36.537230 27264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:36.537362 27264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:36.541514 27264 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.254:41229
I20260808 10:02:36.541582 27360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.254:41229 every 8 connection(s)
I20260808 10:02:36.541981 27264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/data/info.pb
I20260808 10:02:36.543073 27362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:36.544727 27362 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:36.545177 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 27264
I20260808 10:02:36.545293 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-0/wal/instance
I20260808 10:02:36.545499 24863 external_mini_cluster.cc:1428] Setting key 72570d90e118bc810ae3f713cd40f1f0
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.71.253@KRBTEST.COM; defaulting to no policy
I20260808 10:02:36.555356 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.545505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41229 (local address 127.0.0.1:58918)
0808 10:02:36.545688 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.545733 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:36.546244 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:36.546550 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:36.546553 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:36.546846 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:36.547008 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.547012 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.548190 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.548191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.548888 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.548891 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.549457 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.549458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.549526 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.550137 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:36.550147 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:36.551874 (+ 1727us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:36.553757 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.553765 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.553768 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.554076 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.554329 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.554330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.554330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.554433 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.554793 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:36.554798 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:36.554866 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 10:02:36.554943 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 10:02:36.555126 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":104,"threads_started":1}
I20260808 10:02:36.555361 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.545545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58918 (local address 127.24.71.254:41229)
0808 10:02:36.545763 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.545768 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.545826 (+ 58us) server_negotiation.cc:407] Connection header received
0808 10:02:36.546412 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.546414 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.546435 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.546545 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.547121 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.548083 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.549002 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.549341 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.549480 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.551977 (+ 2497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.551986 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.551986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.551993 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.553659 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.554162 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.554165 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.554166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.554249 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.554509 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.554510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.554510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.554730 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.554794 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.555012 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.555210 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":195,"thread_start_us":90,"threads_started":1}
I20260808 10:02:36.556259 27362 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:36.556670 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.556526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:42457 (local address 127.0.0.1:36426)
0808 10:02:36.556577 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.556621 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:42457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.253@KRBTEST.COM" created.
W20260808 10:02:36.556846 27284 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.71.253:42457: connect: Connection refused (error 111)
I20260808 10:02:36.557317 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.557205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:42457 (local address 127.0.0.1:36432)
0808 10:02:36.557262 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.557293 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:42457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 10:02:36.557485 27362 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.253:42457: Network error: Client connection negotiation failed: client connection to 127.24.71.253:42457: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.253.keytab.
Entry for principal kudu/127.24.71.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.253.keytab.
I20260808 10:02:36.574483 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.253:42457
--webserver_interface=127.24.71.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.253.keytab
--principal=kudu/127.24.71.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:45289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:41229,127.24.71.253:42457,127.24.71.252:35525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:02:36.606729 27362 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } attempt: 1
I20260808 10:02:36.607359 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.607194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:42457 (local address 127.0.0.1:36434)
0808 10:02:36.607272 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.607323 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:42457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 10:02:36.607806 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.607721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:42457 (local address 127.0.0.1:36450)
0808 10:02:36.607762 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.607789 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:42457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 10:02:36.607954 27362 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.253:42457: Network error: Client connection negotiation failed: client connection to 127.24.71.253:42457: connect: Connection refused (error 111)
W20260808 10:02:36.659832 27373 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 10:02:36.660089 27373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:36.660108 27373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:36.660131 27373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:36.661372 27373 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:36.661430 27373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:36.661445 27373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:36.661458 27373 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:36.661471 27373 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:36.663117 27373 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:45289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:41229,127.24.71.253:42457,127.24.71.252:35525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.253.keytab
--principal=kudu/127.24.71.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.253:42457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.71.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:36.663404 27373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:36.663714 27373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:36.668951 27385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:36.668970 27373 server_base.cc:1034] running on GCE node
W20260808 10:02:36.668967 27384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:36.668938 27387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:36.669389 27373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:36.669684 27373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:36.670835 27373 hybrid_clock.cc:648] HybridClock initialized: now 1786183356670801 us; error 51 us; skew 500 ppm
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:36.673596 27373 init.cc:377] Logged in from keytab as kudu/127.24.71.253@KRBTEST.COM (short username kudu)
I20260808 10:02:36.674109 27373 webserver.cc:460] Webserver started at http://127.24.71.253:44869/ using document root <none> and password file <none>
I20260808 10:02:36.674312 27373 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:36.674356 27373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:36.674463 27373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:36.675606 27373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/data/instance:
uuid: "589464a104de47259950cda54643a6b0"
format_stamp: "Formatted at 2026-08-08 10:02:36 on dist-test-slave-gw5c"
server_key: "7e86ac6237bd7891fa8d5a9575841cf2"
server_key_iv: "7e221607b712181704d60947b0ab3bd9"
server_key_version: "encryptionkey@0"
I20260808 10:02:36.675928 27373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/wal/instance:
uuid: "589464a104de47259950cda54643a6b0"
format_stamp: "Formatted at 2026-08-08 10:02:36 on dist-test-slave-gw5c"
server_key: "7e86ac6237bd7891fa8d5a9575841cf2"
server_key_iv: "7e221607b712181704d60947b0ab3bd9"
server_key_version: "encryptionkey@0"
I20260808 10:02:36.676119 27362 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } attempt: 2
I20260808 10:02:36.676558 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.676404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:42457 (local address 127.0.0.1:36458)
0808 10:02:36.676490 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.676529 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:42457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 10:02:36.676903 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.676801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:42457 (local address 127.0.0.1:36462)
0808 10:02:36.676845 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.676885 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.253:42457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 10:02:36.676994 27362 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.253:42457: Network error: Client connection negotiation failed: client connection to 127.24.71.253:42457: connect: Connection refused (error 111)
I20260808 10:02:36.677528 27373 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 10:02:36.678306 27397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:36.678499 27373 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:02:36.678597 27373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/wal
uuid: "589464a104de47259950cda54643a6b0"
format_stamp: "Formatted at 2026-08-08 10:02:36 on dist-test-slave-gw5c"
server_key: "7e86ac6237bd7891fa8d5a9575841cf2"
server_key_iv: "7e221607b712181704d60947b0ab3bd9"
server_key_version: "encryptionkey@0"
I20260808 10:02:36.678670 27373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:36.699254 27373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:36.701506 27373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:36.701629 27373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:36.706147 27373 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.253:42457
I20260808 10:02:36.706182 27481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.253:42457 every 8 connection(s)
I20260808 10:02:36.706563 27373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/data/info.pb
I20260808 10:02:36.707681 27482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:36.709298 27482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:36.710531 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 27373
I20260808 10:02:36.710618 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-1/wal/instance
I20260808 10:02:36.710839 24863 external_mini_cluster.cc:1428] Setting key 54ac86481d9752bbd0a770bf5fae36d8
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.253@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:02:36.719466 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.710027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58920 (local address 127.24.71.254:41229)
0808 10:02:36.710090 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.710092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.710305 (+ 213us) server_negotiation.cc:407] Connection header received
0808 10:02:36.710852 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.710853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.710872 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.710955 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.711662 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.712398 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.713364 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.713596 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.713688 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.716341 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.716343 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.716343 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.716352 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.717893 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.718351 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.718352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.718353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.718428 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.718698 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.718700 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.718700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.718841 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.718924 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.719239 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.719337 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 10:02:36.719678 27486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.709984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41229 (local address 127.0.0.1:58920)
0808 10:02:36.710174 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.710215 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:36.710749 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:36.711051 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:36.711055 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:36.711308 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:36.711568 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.711573 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.712503 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.712504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.713265 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.713267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.713718 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.713720 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.713869 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.714440 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:36.714450 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:36.716221 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:36.718002 (+ 1781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.718013 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.718015 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.718265 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.718505 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.718506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.718506 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.718630 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.718919 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:36.718928 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:36.719096 (+ 168us) client_negotiation.cc:769] Sending connection context
0808 10:02:36.719206 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 10:02:36.719381 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":113,"threads_started":1}
WARNING: no policy specified for kudu/127.24.71.252@KRBTEST.COM; defaulting to no policy
I20260808 10:02:36.720350 27482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.71.252@KRBTEST.COM" created.
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.253@KRBTEST.COM for kudu/127.24.71.253@KRBTEST.COM
I20260808 10:02:36.728523 27486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.720647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:42457 (local address 127.0.0.1:36472)
0808 10:02:36.720710 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.720721 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:36.720767 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:36.721089 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:36.721090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:36.721241 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:36.721292 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.721294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.722210 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.722211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.722712 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.722714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.723270 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.723271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.723359 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.723806 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:36.723811 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:36.725309 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:36.727444 (+ 2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.727445 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.727445 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.727628 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.727869 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.727869 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.727870 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.727929 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.728279 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:36.728280 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:36.728320 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 10:02:36.728374 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 10:02:36.728455 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 10:02:36.728768 27488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.720727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36472 (local address 127.24.71.253:42457)
0808 10:02:36.720918 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.720921 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.720968 (+ 47us) server_negotiation.cc:407] Connection header received
0808 10:02:36.720995 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.720997 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.721008 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.721090 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.721414 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.722104 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.722794 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.723182 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.723263 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.725423 (+ 2160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.725432 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.725432 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.725442 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.727320 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.727716 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.727720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.727721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.727796 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.727992 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.727992 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.727993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.728204 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.728300 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.728428 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.728517 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":106,"threads_started":1}
I20260808 10:02:36.729419 27482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:36.729799 27486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.729676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:35525 (local address 127.0.0.1:37064)
0808 10:02:36.729727 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.729780 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 10:02:36.729955 27398 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
I20260808 10:02:36.730434 27486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.730338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:35525 (local address 127.0.0.1:37070)
0808 10:02:36.730389 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.730413 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 10:02:36.730541 27482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:35525: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.71.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.252.keytab.
Entry for principal kudu/127.24.71.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.252.keytab.
I20260808 10:02:36.740376 24863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzT1q8T/build/release/bin/kudu
/tmp/dist-test-taskzT1q8T/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.252:35525
--webserver_interface=127.24.71.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.252.keytab
--principal=kudu/127.24.71.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.71.212:45289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.71.254:41229,127.24.71.253:42457,127.24.71.252:35525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 10:02:36.768141 27362 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } attempt: 3
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for kudu/127.24.71.253@KRBTEST.COM
I20260808 10:02:36.775667 27488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.768650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36486 (local address 127.24.71.253:42457)
0808 10:02:36.768726 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.768728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.768742 (+ 14us) server_negotiation.cc:407] Connection header received
0808 10:02:36.768774 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.768776 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.768789 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.768866 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.769225 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.769740 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.770460 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.770701 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.770785 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.773076 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.773078 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.773078 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.773085 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.774462 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.774810 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.774811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.774811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.774918 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.775130 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.775131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.775132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.775250 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.775328 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.775484 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.775565 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 10:02:36.775667 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.768564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:42457 (local address 127.0.0.1:36486)
0808 10:02:36.768634 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.768646 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:36.768716 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:36.768875 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:36.768875 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:36.769062 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:36.769131 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.769133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.769830 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.769832 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.770363 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.770365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.770782 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.770784 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.770869 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.771467 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:36.771472 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:36.772973 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:36.774551 (+ 1578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.774553 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.774553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.774734 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.774997 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.774997 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.774998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.775064 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.775320 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:36.775321 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:36.775369 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 10:02:36.775461 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 10:02:36.775564 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 10:02:36.776378 27362 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:36.776741 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.776647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:35525 (local address 127.0.0.1:37076)
0808 10:02:36.776684 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.776717 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260808 10:02:36.777056 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.776999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:35525 (local address 127.0.0.1:37086)
0808 10:02:36.777022 (+ 23us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.777043 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260808 10:02:36.777153 27362 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:35525: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
I20260808 10:02:36.779755 27482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } attempt: 1
I20260808 10:02:36.780143 27486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.780027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:35525 (local address 127.0.0.1:37090)
0808 10:02:36.780082 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.780117 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 10:02:36.780514 27486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.780431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:35525 (local address 127.0.0.1:37106)
0808 10:02:36.780474 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.780499 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 10:02:36.780622 27482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:35525: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
I20260808 10:02:36.808300 27362 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } attempt: 1
I20260808 10:02:36.808887 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.808739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:35525 (local address 127.0.0.1:37122)
0808 10:02:36.808814 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.808858 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 10:02:36.809288 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.809204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:35525 (local address 127.0.0.1:37132)
0808 10:02:36.809246 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.809271 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 10:02:36.809417 27362 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:35525: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
W20260808 10:02:36.830324 27492 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 10:02:36.830534 27492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 10:02:36.830551 27492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 10:02:36.830571 27492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 10:02:36.831707 27492 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 10:02:36.831748 27492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 10:02:36.831763 27492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 10:02:36.831776 27492 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 10:02:36.831795 27492 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 10:02:36.833259 27492 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.71.212:45289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.71.254:41229,127.24.71.253:42457,127.24.71.252:35525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/krb5kdc/kudu_127.24.71.252.keytab
--principal=kudu/127.24.71.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.71.252:35525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.71.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 08:05:23 UTC on ccycloud.quasar-slepfe.root.comops.site
build id 4574261
I20260808 10:02:36.833460 27492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 10:02:36.833638 27492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 10:02:36.838547 27501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:36.838649 27499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 10:02:36.838573 27498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 10:02:36.839015 27492 server_base.cc:1034] running on GCE node
I20260808 10:02:36.839300 27492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 10:02:36.839615 27492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 10:02:36.840765 27492 hybrid_clock.cc:648] HybridClock initialized: now 1786183356840741 us; error 36 us; skew 500 ppm
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 10:02:36.843343 27492 init.cc:377] Logged in from keytab as kudu/127.24.71.252@KRBTEST.COM (short username kudu)
I20260808 10:02:36.843876 27492 webserver.cc:460] Webserver started at http://127.24.71.252:34041/ using document root <none> and password file <none>
I20260808 10:02:36.844132 27492 fs_manager.cc:359] Metadata directory not provided
I20260808 10:02:36.844205 27492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 10:02:36.844369 27492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 10:02:36.845461 27492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/data/instance:
uuid: "e57910f9aac247eb894c7c7a16d86653"
format_stamp: "Formatted at 2026-08-08 10:02:36 on dist-test-slave-gw5c"
server_key: "162912e432462a2179e2f5e7bb924cc9"
server_key_iv: "29d81479a5bdbcfc5951afeed7a8a028"
server_key_version: "encryptionkey@0"
I20260808 10:02:36.845839 27492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/wal/instance:
uuid: "e57910f9aac247eb894c7c7a16d86653"
format_stamp: "Formatted at 2026-08-08 10:02:36 on dist-test-slave-gw5c"
server_key: "162912e432462a2179e2f5e7bb924cc9"
server_key_iv: "29d81479a5bdbcfc5951afeed7a8a028"
server_key_version: "encryptionkey@0"
I20260808 10:02:36.847267 27492 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 10:02:36.848098 27510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 10:02:36.848279 27492 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 10:02:36.848418 27492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/data,/tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/wal
uuid: "e57910f9aac247eb894c7c7a16d86653"
format_stamp: "Formatted at 2026-08-08 10:02:36 on dist-test-slave-gw5c"
server_key: "162912e432462a2179e2f5e7bb924cc9"
server_key_iv: "29d81479a5bdbcfc5951afeed7a8a028"
server_key_version: "encryptionkey@0"
I20260808 10:02:36.848496 27492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 10:02:36.848757 27482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } attempt: 2
I20260808 10:02:36.849160 27486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.849039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:35525 (local address 127.0.0.1:37136)
0808 10:02:36.849096 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.849132 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 10:02:36.849510 27486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.849416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:35525 (local address 127.0.0.1:37138)
0808 10:02:36.849462 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.849492 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 10:02:36.849596 27482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.71.252:35525: Network error: Client connection negotiation failed: client connection to 127.24.71.252:35525: connect: Connection refused (error 111)
I20260808 10:02:36.862596 27492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 10:02:36.864835 27492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 10:02:36.865002 27492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 10:02:36.869318 27492 rpc_server.cc:307] RPC server started. Bound to: 127.24.71.252:35525
I20260808 10:02:36.869357 27588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.71.252:35525 every 8 connection(s)
I20260808 10:02:36.869750 27492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/data/info.pb
I20260808 10:02:36.870756 27589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 10:02:36.872328 27589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } has no permanent_uuid. Determining permanent_uuid...
I20260808 10:02:36.876536 24863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzT1q8T/build/release/bin/kudu as pid 27492
I20260808 10:02:36.876667 24863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzT1q8T/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786183068256695-24863-0/minicluster-data/master-2/wal/instance
I20260808 10:02:36.876889 24863 external_mini_cluster.cc:1428] Setting key 3c0338ce186c000b53c8dfcd91b866e3
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.252@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:02:36.881819 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.873011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58924 (local address 127.24.71.254:41229)
0808 10:02:36.873100 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.873103 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.873297 (+ 194us) server_negotiation.cc:407] Connection header received
0808 10:02:36.873823 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.873824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.873836 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.873886 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.874539 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.875031 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.876076 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.876287 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.876374 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.878717 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.878718 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.878719 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.878728 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.880279 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.880671 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.880673 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.880673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.880745 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.881091 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.881092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.881092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.881243 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.881328 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.881601 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.881697 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 10:02:36.882007 27593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.872965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.254:41229 (local address 127.0.0.1:58924)
0808 10:02:36.873175 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.873211 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:36.873710 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:36.873976 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:36.873979 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:36.874235 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:36.874439 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.874443 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.875131 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.875132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.875981 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.875984 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.876430 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.876431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.876538 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.877100 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:36.877111 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:36.878627 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:36.880360 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.880367 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.880369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.880595 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.880820 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.880821 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.880822 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.880995 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.881327 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:36.881333 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:36.881461 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 10:02:36.881550 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 10:02:36.881719 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":104,"threads_started":1}
I20260808 10:02:36.882624 27589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.252@KRBTEST.COM
I20260808 10:02:36.884541 27362 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } attempt: 2
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.252@KRBTEST.COM for kudu/127.24.71.253@KRBTEST.COM
I20260808 10:02:36.887203 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.877292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37150 (local address 127.24.71.252:35525)
0808 10:02:36.877476 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.877481 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.877536 (+ 55us) server_negotiation.cc:407] Connection header received
0808 10:02:36.877609 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.877612 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.877632 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.877721 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.878328 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.879257 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.880203 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.880597 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.880689 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.883574 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.883582 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.883582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.883590 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.885635 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.886312 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.886315 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.886315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.886381 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.886596 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.886597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.886598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.886748 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.886923 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.887005 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.887086 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":99,"threads_started":1}
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.254@KRBTEST.COM for kudu/127.24.71.252@KRBTEST.COM
I20260808 10:02:36.890532 27593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.882899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.253:42457 (local address 127.0.0.1:36492)
0808 10:02:36.882946 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.882956 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:36.882992 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:36.883177 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:36.883179 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:36.883334 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:36.883436 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.883439 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.884358 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.884360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.885135 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.885137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.885511 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.885512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.885587 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.886005 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:36.886010 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:36.887579 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:36.889197 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.889198 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.889199 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.889380 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.889859 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.889860 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.889860 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.889928 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.890234 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:36.890235 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:36.890268 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 10:02:36.890347 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 10:02:36.890440 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 10:02:36.890539 27488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.882977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36492 (local address 127.24.71.253:42457)
0808 10:02:36.883021 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.883023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.883032 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:02:36.883059 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.883060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.883070 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.883127 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.883512 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.884254 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.885217 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.885436 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.885513 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.887677 (+ 2164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.887678 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.887679 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.887686 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.889116 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.889473 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.889475 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.889475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.889534 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.890017 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.890018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.890018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.890157 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.890193 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.890374 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.890454 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 10:02:36.890884 27589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.254@KRBTEST.COM
I20260808 10:02:36.894356 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.884883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:35525 (local address 127.0.0.1:37152)
0808 10:02:36.884929 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.884938 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:36.884972 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:36.885230 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:36.885231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:36.885381 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:36.885456 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.885458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.886174 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.886176 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.886997 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.887001 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.887573 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.887574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.887640 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.887978 (+ 338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:36.887987 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:36.889531 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:36.893176 (+ 3645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.893177 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.893178 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.893376 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.893620 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.893621 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.893621 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.893689 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.894002 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:36.894003 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:36.894056 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 10:02:36.894141 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 10:02:36.894252 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 10:02:36.894836 27597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.884935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37152 (local address 127.24.71.252:35525)
0808 10:02:36.885080 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.885082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.885091 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:02:36.885110 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.885111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.885120 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.885536 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.885581 (+ 45us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.886095 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.887096 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.887471 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.887783 (+ 312us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.889613 (+ 1830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.889615 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.889615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.889622 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.893087 (+ 3465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.893473 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.893474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.893475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.893540 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.893771 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.893772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.893772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.893902 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.894538 (+ 636us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.894584 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.894660 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":97,"threads_started":1}
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.252@KRBTEST.COM for kudu/127.24.71.252@KRBTEST.COM
I20260808 10:02:36.896559 27362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad: Bootstrap starting.
I20260808 10:02:36.897163 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.888349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58928 (local address 127.24.71.254:41229)
0808 10:02:36.888395 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.888397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.888622 (+ 225us) server_negotiation.cc:407] Connection header received
0808 10:02:36.888721 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.888722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.888733 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.888793 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.889357 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.889910 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.890967 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.891233 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.891275 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.893943 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.893944 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.893945 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.893952 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.895768 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.896148 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.896149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.896149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.896203 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.896432 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.896433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.896434 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.896567 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.896692 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.896999 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.897073 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 10:02:36.897560 27362 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:36.897930 27362 log.cc:824] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:36.898809 27593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.891141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:35525 (local address 127.0.0.1:37156)
0808 10:02:36.891283 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.891292 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:36.891329 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:36.891886 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:36.891887 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:36.892062 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:36.892093 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.892095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.892669 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.892670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.893122 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.893123 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.893594 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.893595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.893653 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.894067 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:36.894072 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:36.895668 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:36.897714 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.897714 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.897714 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.897947 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.898175 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.898175 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.898176 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.898230 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.898506 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:36.898506 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:36.898546 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 10:02:36.898618 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 10:02:36.898724 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":97,"threads_started":1}
I20260808 10:02:36.898944 27362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad: No bootstrap required, opened a new log
I20260808 10:02:36.899181 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.891313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37156 (local address 127.24.71.252:35525)
0808 10:02:36.891537 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.891539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.891547 (+ 8us) server_negotiation.cc:407] Connection header received
0808 10:02:36.891563 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.891564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.891574 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.891870 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.892153 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.892586 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.893209 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.893527 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.893596 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.895763 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.895765 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.895766 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.895772 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.897640 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.898027 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.898028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.898028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.898090 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.898303 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.898304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.898304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.898434 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.898513 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.898655 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.898788 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":207}
I20260808 10:02:36.901131 27362 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } }
I20260808 10:02:36.901302 27362 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99f22521fe21434d8b537c4c609ee4ad, State: Initialized, Role: FOLLOWER
I20260808 10:02:36.901404 27362 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } }
I20260808 10:02:36.901707 27600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } } }
I20260808 10:02:36.901790 27362 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:36.901813 27600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [sys.catalog]: This master's current role is: FOLLOWER
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.71.253@KRBTEST.COM
W20260808 10:02:36.903764 27626 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 10:02:36.903820 27626 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 10:02:36.904381 27589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653: Bootstrap starting.
I20260808 10:02:36.905020 27589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:36.905398 27589 log.cc:824] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:36.906358 27589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653: No bootstrap required, opened a new log
I20260808 10:02:36.906472 27488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.898110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36494 (local address 127.24.71.253:42457)
0808 10:02:36.898149 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.898151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.898191 (+ 40us) server_negotiation.cc:407] Connection header received
0808 10:02:36.898262 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.898263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.898273 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.898320 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.898957 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.899674 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.900578 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.900771 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.900827 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.903265 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.903267 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.903267 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.903274 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.904880 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.905267 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.905268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.905269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.905338 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.905556 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.905557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.905557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.905713 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.905884 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.906281 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.906357 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 10:02:36.907922 24863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 10:02:36.908857 27320 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "99f22521fe21434d8b537c4c609ee4ad"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58928
I20260808 10:02:36.908834 27589 raft_consensus.cc:348] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } }
I20260808 10:02:36.908982 27320 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 10:02:36.908993 27589 raft_consensus.cc:729] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e57910f9aac247eb894c7c7a16d86653, State: Initialized, Role: FOLLOWER
I20260808 10:02:36.909025 27320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:36.909071 27589 consensus_queue.cc:260] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } }
I20260808 10:02:36.909358 27589 sys_catalog.cc:564] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:36.909950 27320 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } }
I20260808 10:02:36.910169 27320 leader_election.cc:288] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [CANDIDATE]: Term 1 election: Requested vote from peers 589464a104de47259950cda54643a6b0 (127.24.71.253:42457), e57910f9aac247eb894c7c7a16d86653 (127.24.71.252:35525)
I20260808 10:02:36.907267 27264 master_runner.cc:186] Error getting master registration for 127.24.71.253:42457: OK, instance_id { permanent_uuid: "589464a104de47259950cda54643a6b0" instance_seqno: 1786183356704853 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 10:02:36.910533 27264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 10:02:36.910537 27551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "99f22521fe21434d8b537c4c609ee4ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e57910f9aac247eb894c7c7a16d86653"
I20260808 10:02:36.910650 27551 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:36.911912 27551 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99f22521fe21434d8b537c4c609ee4ad in term 1.
I20260808 10:02:36.912109 27284 leader_election.cc:302] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99f22521fe21434d8b537c4c609ee4ad, e57910f9aac247eb894c7c7a16d86653; no voters:
I20260808 10:02:36.912233 27600 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [term 1 FOLLOWER]: Leader election won for term 1
I20260808 10:02:36.912233 27629 sys_catalog.cc:455] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } } }
I20260808 10:02:36.912338 27629 sys_catalog.cc:458] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:02:36.912407 27600 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [term 1 LEADER]: Becoming Leader. State: Replica: 99f22521fe21434d8b537c4c609ee4ad, State: Running, Role: LEADER
I20260808 10:02:36.912497 27600 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } }
I20260808 10:02:36.912992 27647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99f22521fe21434d8b537c4c609ee4ad. Latest consensus state: current_term: 1 leader_uuid: "99f22521fe21434d8b537c4c609ee4ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } } }
I20260808 10:02:36.913106 27647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:36.914762 27649 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 10:02:36.914995 27649 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 10:02:36.914707 27492 master_runner.cc:186] Error getting master registration for 127.24.71.253:42457: OK, instance_id { permanent_uuid: "589464a104de47259950cda54643a6b0" instance_seqno: 1786183356704853 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 10:02:36.917501 27492 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 10:02:36.920842 27646 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 10:02:36.920922 27646 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 10:02:36.924947 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.913962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58932 (local address 127.24.71.254:41229)
0808 10:02:36.914015 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.914018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.914369 (+ 351us) server_negotiation.cc:407] Connection header received
0808 10:02:36.914552 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.914553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.914563 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.914595 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.916297 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.917027 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.918460 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.918726 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.918793 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.921021 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.921023 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.921024 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.921032 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.922934 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.923638 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.923640 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.923640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.923708 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.924063 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.924064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.924064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.924231 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.924344 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.924714 (+ 370us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.924820 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 10:02:36.926326 27488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.914219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36504 (local address 127.24.71.253:42457)
0808 10:02:36.914281 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.914283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.914435 (+ 152us) server_negotiation.cc:407] Connection header received
0808 10:02:36.917692 (+ 3257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.917694 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.917707 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.917771 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.918513 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.919229 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.920631 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.920928 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.920977 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.923236 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.923238 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.923238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.923245 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.924971 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.925421 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.925422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.925422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.925477 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.925679 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.925680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.925681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.925860 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.925980 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.926107 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.926209 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 10:02:36.927474 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.914255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37170 (local address 127.24.71.252:35525)
0808 10:02:36.914293 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.914295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.914585 (+ 290us) server_negotiation.cc:407] Connection header received
0808 10:02:36.914661 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.914662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.914673 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.914727 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.920128 (+ 5401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.920899 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.921865 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.922142 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.922208 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.924059 (+ 1851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.924061 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.924061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.924328 (+ 267us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.926064 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.926608 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.926609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.926609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.926669 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.926883 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.926884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.926884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.927027 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.927142 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.927243 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.927327 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 10:02:36.932541 27551 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653 [term 1 FOLLOWER]: Refusing update from remote peer 99f22521fe21434d8b537c4c609ee4ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:02:36.933386 27647 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:02:36.935101 27629 sys_catalog.cc:455] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99f22521fe21434d8b537c4c609ee4ad. Latest consensus state: current_term: 1 leader_uuid: "99f22521fe21434d8b537c4c609ee4ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } } }
I20260808 10:02:36.935194 27629 sys_catalog.cc:458] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:02:36.936515 27647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "99f22521fe21434d8b537c4c609ee4ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } } }
I20260808 10:02:36.936614 27647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:36.936795 27659 mvcc.cc:205] Tried to move back new op lower bound from 7316207029992542208 to 7316207029914267648. Current Snapshot: MvccSnapshot[applied={T|T < 7316207029992542208}]
I20260808 10:02:36.937079 27661 mvcc.cc:205] Tried to move back new op lower bound from 7316207029992542208 to 7316207029914267648. Current Snapshot: MvccSnapshot[applied={T|T < 7316207029992542208}]
I20260808 10:02:36.937278 27629 sys_catalog.cc:455] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "99f22521fe21434d8b537c4c609ee4ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } } }
I20260808 10:02:36.937359 27629 sys_catalog.cc:458] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:02:36.939913 27649 catalog_manager.cc:1347] Generated new cluster ID: e54d2c116fa448c4889ac1c1dcb27951
I20260808 10:02:36.939963 27649 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 10:02:36.940749 27482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } attempt: 3
Aug 08 10:02:36 dist-test-slave-gw5c krb5kdc[27245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786183356, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.71.253@KRBTEST.COM for kudu/127.24.71.252@KRBTEST.COM
I20260808 10:02:36.953081 27486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.943628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.71.252:35525 (local address 127.0.0.1:37176)
0808 10:02:36.943725 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0808 10:02:36.943737 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 10:02:36.943777 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 10:02:36.944400 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 10:02:36.944401 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 10:02:36.944609 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0808 10:02:36.944663 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.944665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.945591 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.945592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.946405 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 10:02:36.946407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.946914 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.946915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 10:02:36.946970 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.947533 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 10:02:36.947539 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 10:02:36.949047 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 10:02:36.951819 (+ 2772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.951819 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.951820 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.952061 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.952312 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 10:02:36.952313 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 10:02:36.952313 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 10:02:36.952395 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 10:02:36.952741 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 10:02:36.952742 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 10:02:36.952801 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 10:02:36.952864 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 10:02:36.952971 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 10:02:36.953471 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:36.943934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37176 (local address 127.24.71.252:35525)
0808 10:02:36.943981 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:36.943983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:36.943991 (+ 8us) server_negotiation.cc:407] Connection header received
0808 10:02:36.944014 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:36.944015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:36.944025 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:36.944082 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:36.944753 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.945493 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.946503 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:36.946800 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:36.946857 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:36.949144 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 10:02:36.949146 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 10:02:36.949146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 10:02:36.949153 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 10:02:36.950830 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.952158 (+ 1328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.952159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.952160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.952233 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 10:02:36.952464 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 10:02:36.952465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 10:02:36.952466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 10:02:36.952616 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 10:02:36.952679 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:36.953289 (+ 610us) server_negotiation.cc:299] Negotiation successful
0808 10:02:36.953379 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 10:02:36.955054 27482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0: Bootstrap starting.
I20260808 10:02:36.955889 27482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0: Neither blocks nor log segments found. Creating new log.
I20260808 10:02:36.956208 27482 log.cc:824] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0: Log is configured to *not* fsync() on all Append() calls
I20260808 10:02:36.957253 27482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0: No bootstrap required, opened a new log
I20260808 10:02:36.959375 27482 raft_consensus.cc:348] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } }
I20260808 10:02:36.959596 27482 raft_consensus.cc:729] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 589464a104de47259950cda54643a6b0, State: Initialized, Role: FOLLOWER
I20260808 10:02:36.959682 27482 consensus_queue.cc:260] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } }
I20260808 10:02:36.960044 27482 sys_catalog.cc:564] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 10:02:36.960156 27437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 10:02:36.961156 27437 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0 [term 1 FOLLOWER]: Refusing update from remote peer 99f22521fe21434d8b537c4c609ee4ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 10:02:36.961848 27600 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 10:02:36.962461 27439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "99f22521fe21434d8b537c4c609ee4ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "589464a104de47259950cda54643a6b0"
I20260808 10:02:36.963308 27439 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99f22521fe21434d8b537c4c609ee4ad in term 1.
W20260808 10:02:36.966035 27689 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 10:02:36.966104 27689 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 10:02:36.966454 27669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99f22521fe21434d8b537c4c609ee4ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } } }
I20260808 10:02:36.966547 27669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:02:36.966610 27669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99f22521fe21434d8b537c4c609ee4ad. Latest consensus state: current_term: 1 leader_uuid: "99f22521fe21434d8b537c4c609ee4ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } } }
I20260808 10:02:36.966665 27669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:02:36.966698 27669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "99f22521fe21434d8b537c4c609ee4ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } } }
I20260808 10:02:36.966740 27669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 10:02:36.971895 27693 mvcc.cc:205] Tried to move back new op lower bound from 7316207029992542208 to 7316207029914267648. Current Snapshot: MvccSnapshot[applied={T|T < 7316207029992542208}]
I20260808 10:02:36.974026 27649 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 10:02:36.975275 27649 catalog_manager.cc:1504] Loading token signing keys...
I20260808 10:02:36.981217 27647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "99f22521fe21434d8b537c4c609ee4ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99f22521fe21434d8b537c4c609ee4ad" member_type: VOTER last_known_addr { host: "127.24.71.254" port: 41229 } } peers { permanent_uuid: "589464a104de47259950cda54643a6b0" member_type: VOTER last_known_addr { host: "127.24.71.253" port: 42457 } } peers { permanent_uuid: "e57910f9aac247eb894c7c7a16d86653" member_type: VOTER last_known_addr { host: "127.24.71.252" port: 35525 } } }
I20260808 10:02:36.981326 27647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad [sys.catalog]: This master's current role is: LEADER
I20260808 10:02:36.987490 27649 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99f22521fe21434d8b537c4c609ee4ad: Generated new TSK 0
I20260808 10:02:36.987741 27649 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 10:02:37.027909 27366 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:37.025989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58940 (local address 127.24.71.254:41229)
0808 10:02:37.026040 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:37.026042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:37.027072 (+ 1030us) server_negotiation.cc:407] Connection header received
0808 10:02:37.027194 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:37.027196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:37.027209 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:37.027258 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:37.027823 (+ 565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58940: BlockingRecv error: recv got EOF from 127.0.0.1:58940 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 10:02:37.028960 27488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:37.026445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36506 (local address 127.24.71.253:42457)
0808 10:02:37.026489 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:37.026491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:37.028367 (+ 1876us) server_negotiation.cc:407] Connection header received
0808 10:02:37.028478 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:37.028479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:37.028492 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:37.028524 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:37.028893 (+ 369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36506: BlockingRecv error: recv got EOF from 127.0.0.1:36506 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 10:02:37.029908 27596 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:37.026780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37192 (local address 127.24.71.252:35525)
0808 10:02:37.026823 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:37.026825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:37.029370 (+ 2545us) server_negotiation.cc:407] Connection header received
0808 10:02:37.029475 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:37.029476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:37.029487 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:37.029517 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:37.029846 (+ 329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37192: BlockingRecv error: recv got EOF from 127.0.0.1:37192 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 10:02:37.032648 27488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:37.031807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36516 (local address 127.24.71.253:42457)
0808 10:02:37.031844 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:37.031846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:37.032099 (+ 253us) server_negotiation.cc:407] Connection header received
0808 10:02:37.032207 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:37.032208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:37.032241 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:37.032271 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:37.032599 (+ 328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36516: BlockingRecv error: recv got EOF from 127.0.0.1:36516 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 10:02:37.035912 27488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:37.035110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36532 (local address 127.24.71.253:42457)
0808 10:02:37.035143 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:37.035145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:37.035383 (+ 238us) server_negotiation.cc:407] Connection header received
0808 10:02:37.035509 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:37.035510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:37.035521 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:37.035550 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:37.035867 (+ 317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36532: BlockingRecv error: recv got EOF from 127.0.0.1:36532 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 10:02:37.040092 27488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:37.039286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36540 (local address 127.24.71.253:42457)
0808 10:02:37.039322 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:37.039323 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:37.039573 (+ 250us) server_negotiation.cc:407] Connection header received
0808 10:02:37.039676 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:37.039677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:37.039688 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:37.039717 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:37.040047 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36540: BlockingRecv error: recv got EOF from 127.0.0.1:36540 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 10:02:37.046309 27488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:37.045452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36544 (local address 127.24.71.253:42457)
0808 10:02:37.045490 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:37.045492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:37.045729 (+ 237us) server_negotiation.cc:407] Connection header received
0808 10:02:37.045837 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:37.045838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:37.045849 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:37.045879 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:37.046256 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36544: BlockingRecv error: recv got EOF from 127.0.0.1:36544 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 10:02:37.056762 27488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:37.055846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36554 (local address 127.24.71.253:42457)
0808 10:02:37.055894 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:37.055896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:37.056136 (+ 240us) server_negotiation.cc:407] Connection header received
0808 10:02:37.056255 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:37.056256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:37.056268 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:37.056300 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:37.056691 (+ 391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36554: BlockingRecv error: recv got EOF from 127.0.0.1:36554 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 10:02:37.075383 27488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:37.074403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36570 (local address 127.24.71.253:42457)
0808 10:02:37.074451 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:37.074453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:37.074737 (+ 284us) server_negotiation.cc:407] Connection header received
0808 10:02:37.074848 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:37.074849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:37.074861 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:37.074894 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:37.075321 (+ 427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36570: BlockingRecv error: recv got EOF from 127.0.0.1:36570 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 10:02:37.110121 27488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:37.109104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36580 (local address 127.24.71.253:42457)
0808 10:02:37.109157 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:37.109160 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:37.109323 (+ 163us) server_negotiation.cc:407] Connection header received
0808 10:02:37.109480 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:37.109481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:37.109495 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:37.109554 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:37.110050 (+ 496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36580: BlockingRecv error: recv got EOF from 127.0.0.1:36580 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260808 10:02:37.176425 27488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:37.175618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36592 (local address 127.24.71.253:42457)
0808 10:02:37.175689 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:37.175692 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:37.175799 (+ 107us) server_negotiation.cc:407] Connection header received
0808 10:02:37.175854 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:37.175854 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:37.175866 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:37.175936 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:37.176312 (+ 376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36592: BlockingRecv error: recv got EOF from 127.0.0.1:36592 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 10:02:37.306514 27488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:37.305768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36604 (local address 127.24.71.253:42457)
0808 10:02:37.305870 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:37.305872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:37.305884 (+ 12us) server_negotiation.cc:407] Connection header received
0808 10:02:37.305971 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:37.305972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:37.305984 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:37.306040 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:37.306417 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36604: BlockingRecv error: recv got EOF from 127.0.0.1:36604 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 10:02:37.564540 27488 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 10:02:37.563888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36608 (local address 127.24.71.253:42457)
0808 10:02:37.563965 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:37.563967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:37.563977 (+ 10us) server_negotiation.cc:407] Connection header received
0808 10:02:37.564002 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:37.564003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:37.564013 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:37.564064 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 10:02:37.564459 (+ 395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36608: BlockingRecv error: recv got EOF from 127.0.0.1:36608 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 10:02:37.921458 27646 catalog_manager.cc:1259] Loaded cluster ID: e54d2c116fa448c4889ac1c1dcb27951
I20260808 10:02:37.921577 27646 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653: loading cluster ID for follower catalog manager: success
I20260808 10:02:37.922444 27646 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653: acquiring CA information for follower catalog manager: success
I20260808 10:02:37.922811 27646 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e57910f9aac247eb894c7c7a16d86653: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 10:02:37.966624 27689 catalog_manager.cc:1259] Loaded cluster ID: e54d2c116fa448c4889ac1c1dcb27951
I20260808 10:02:37.966717 27689 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0: loading cluster ID for follower catalog manager: success
I20260808 10:02:37.967713 27689 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0: acquiring CA information for follower catalog manager: success
I20260808 10:02:37.968122 27689 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 589464a104de47259950cda54643a6b0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 10:02:38.080659 27803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:38.077814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36620 (local address 127.24.71.253:42457)
0808 10:02:38.077974 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:38.077976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:38.077990 (+ 14us) server_negotiation.cc:407] Connection header received
0808 10:02:38.078025 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:38.078026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:38.078098 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:38.078192 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:02:38.078384 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:38.078910 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:38.079789 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:38.080004 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:38.080090 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:38.080274 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:38.080405 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:38.080501 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:38.080525 (+ 24us) server_negotiation.cc:299] Negotiation successful
0808 10:02:38.080549 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":57,"threads_started":1}
I20260808 10:02:38.085413 27812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:38.082778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37204 (local address 127.24.71.252:35525)
0808 10:02:38.082929 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:38.082931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:38.082940 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:02:38.082990 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:38.082991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:38.083043 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:38.083137 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:02:38.083272 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:38.083785 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:38.084558 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:38.084782 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:38.084861 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:38.085027 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:38.085155 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:38.085248 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:38.085288 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 10:02:38.085312 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":64,"threads_started":1}
I20260808 10:02:38.089952 27803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:38.087556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36626 (local address 127.24.71.253:42457)
0808 10:02:38.087599 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:38.087601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:38.087609 (+ 8us) server_negotiation.cc:407] Connection header received
0808 10:02:38.087637 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:38.087638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:38.087649 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:38.087699 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:02:38.087966 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:38.088450 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:38.089224 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:38.089430 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:38.089510 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:38.089676 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:38.089716 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:38.089766 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:38.089828 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 10:02:38.089856 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 10:02:38.090471 27812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:38.087514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37214 (local address 127.24.71.252:35525)
0808 10:02:38.087555 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:38.087557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:38.087670 (+ 113us) server_negotiation.cc:407] Connection header received
0808 10:02:38.087736 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:38.087737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:38.087746 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:38.087796 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:02:38.087942 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:38.088637 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:38.089620 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:38.089923 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:38.089984 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:38.090210 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:38.090243 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:38.090311 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:38.090375 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 10:02:38.090396 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 10:02:38.090924 27822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 10:02:38.087073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58942 (local address 127.24.71.254:41229)
0808 10:02:38.087213 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 10:02:38.087215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 10:02:38.087224 (+ 9us) server_negotiation.cc:407] Connection header received
0808 10:02:38.087275 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 10:02:38.087276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 10:02:38.087329 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 10:02:38.087492 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 10:02:38.087643 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:38.088459 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:38.089567 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 10:02:38.089874 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 10:02:38.089942 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 10:02:38.090368 (+ 426us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 10:02:38.090497 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 10:02:38.090565 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 10:02:38.090648 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 10:02:38.090676 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":62,"threads_started":1}
I20260808 10:02:38.092903 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 27264
I20260808 10:02:38.107374 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 27373
I20260808 10:02:38.121469 24863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzT1q8T/build/release/bin/kudu with pid 27492
2026-08-08T10:02:38Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3093 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6148 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (289880 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST